-- Logs begin at Thu 2022-07-28 10:23:33 UTC, end at Thu 2022-07-28 11:31:28 UTC. -- Jul 28 11:02:55.962177 dv-osbrick-850937-3-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 11:02:55.973201 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 11:02:55.975393 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 11:02:55 2022] *** Jul 28 11:02:55.975393 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 11:02:55.975393 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 11:02:55.975393 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: nodename: dv-osbrick-850937-3-ceph Jul 28 11:02:55.975393 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: machine: x86_64 Jul 28 11:02:55.975393 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: clock source: unix Jul 28 11:02:55.975393 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: pcre jit disabled Jul 28 11:02:55.975393 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: detected number of CPU cores: 4 Jul 28 11:02:55.975393 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: current working directory: / Jul 28 11:02:55.975393 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: detected binary path: /usr/bin/uwsgi-core Jul 28 11:02:55.975393 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: your processes number limit is 47680 Jul 28 11:02:55.975393 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: your memory page size is 4096 bytes Jul 28 11:02:55.975393 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: detected max file descriptor number: 2048 Jul 28 11:02:55.975393 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: lock engine: pthread robust mutexes Jul 28 11:02:55.976636 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: thunder lock: enabled Jul 28 11:02:55.976636 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 11:02:55.976636 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 11:02:56.021646 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: Python main interpreter initialized at 0x55b2aec359c0 Jul 28 11:02:56.021646 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: python threads support enabled Jul 28 11:02:56.021646 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: your server socket listen backlog is limited to 100 connections Jul 28 11:02:56.021646 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: your mercy for graceful operations on workers is 90 seconds Jul 28 11:02:56.022181 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 11:02:56.022181 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: *** Operational MODE: preforking *** Jul 28 11:02:56.026714 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: *** uWSGI is running in multiple interpreter mode *** Jul 28 11:02:56.026714 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: spawned uWSGI master process (pid: 87192) Jul 28 11:02:56.026714 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: spawned uWSGI worker 1 (pid: 87205, cores: 1) Jul 28 11:02:56.026714 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: spawned uWSGI worker 2 (pid: 87206, cores: 1) Jul 28 11:02:56.026714 dv-osbrick-850937-3-ceph devstack@keystone.service[87192]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 11:02:56.022583 dv-osbrick-850937-3-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 28 11:03:02.257747 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 11:03:02.257747 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: from cryptography.utils import int_from_bytes Jul 28 11:03:02.258793 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 11:03:02.258793 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: from cryptography.utils import int_from_bytes Jul 28 11:03:02.309554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 11:03:02.309554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 11:03:02.310460 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] command line args: [] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 11:03:02.310460 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 11:03:02.310460 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ================================================================================ {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 11:03:02.311061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] admin_token = **** {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.311061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] config_dir = [] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.311061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.311411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] config_source = [] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.311411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] debug = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.311729 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.312108 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.313198 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.313198 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.313198 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.313198 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] list_limit = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.313198 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] log_config_append = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.313534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.313534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] log_dir = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.313649 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] log_file = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.313863 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.314117 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.314369 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.314620 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.314798 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.314979 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.315230 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.315502 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.315745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.316016 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.316221 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.316451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.316703 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.316952 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.317234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.317734 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.317919 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] publish_errors = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.318148 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.318387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.318567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.318814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.319047 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.319307 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] standard_threads = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.319547 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.319797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.319974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.320151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] use_journal = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.320331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] use_json = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.320506 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] use_stderr = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.320684 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] use_syslog = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.320980 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.321248 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.321486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.321754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.321998 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.322249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.322491 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.322740 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.322981 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.323233 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.323509 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.323765 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.324003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.324254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.324493 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.324743 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.324992 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.325233 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.325492 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.325812 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.326068 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.326326 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.326503 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.326770 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.327029 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.327303 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.327703 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.327783 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.327978 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.328216 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.328470 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.328840 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.328942 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.329177 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.329426 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.329675 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.329916 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.330169 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.330417 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.330723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.330880 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.331112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.331370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.331607 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.331856 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.332094 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.332350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.332993 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.332993 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.333213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.333296 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.333494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.333743 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.333975 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.334218 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.334458 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.334699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.334938 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.335023 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 11:03:02.335023 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: from cryptography.utils import int_from_bytes Jul 28 11:03:02.335612 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.335692 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 11:03:02.335692 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: from cryptography.utils import int_from_bytes Jul 28 11:03:02.335852 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.335852 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.336046 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.336141 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.336341 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.337143 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.337386 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.337621 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.337864 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.338103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.338377 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.338622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.338868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.339126 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.339388 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.339639 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.339882 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.340134 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.340377 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.340618 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.340864 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.341104 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.341346 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.341587 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.341827 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.342066 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.342337 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.342581 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.342825 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.343066 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.343339 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.343585 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.343825 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.344064 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.344298 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.344531 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.344764 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.345005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.345237 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.345480 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.345718 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.345969 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.346209 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.346610 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.346876 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.347122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.347383 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] auth.external = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.347620 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.347923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.348163 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.348400 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] auth.password = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.348635 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] auth.token = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.348882 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.349123 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.349394 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.349618 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.349871 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.350124 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.350359 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.350599 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] credential.caching = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.350852 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.351105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.351382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.351629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.351877 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.352185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.352457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.352717 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.352961 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.353220 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.353510 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.354290 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.354563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.354810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.355070 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.355344 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] federation.caching = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.355597 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.355851 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.356103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.356337 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.356589 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.356830 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.357088 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.357328 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.357588 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.357832 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.358086 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.358335 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] identity.caching = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.358588 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.358839 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.359080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.359343 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.359596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.359830 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.360073 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.360327 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.360584 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.360817 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.361050 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.361307 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.361609 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.361950 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.362373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.362746 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.363164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.363680 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.364002 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.364328 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.364720 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.365079 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.365471 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.365899 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.366344 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.366792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.367068 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.367352 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.367619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.367926 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.368176 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.368436 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.368695 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.368939 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.369190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.369429 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.369676 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.369931 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.370228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.370430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.373072 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.373072 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.373072 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.373072 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.373072 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.373072 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.373072 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.373072 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.373072 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.374284 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.374284 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.user = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.374284 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.374284 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.374284 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.374284 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.374284 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.375152 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.375152 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.375152 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.375152 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.375710 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.375710 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.376511 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.376511 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.376511 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.376861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.376861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.377095 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.377264 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.377516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.377761 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.378005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.378246 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.378486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.378740 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.378993 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.379248 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.379534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.379770 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.380020 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.380277 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.380513 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.380757 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.381014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.381256 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.381495 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.381741 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.381981 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] resource.caching = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.382244 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.382498 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.382738 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.382993 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.383303 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.383538 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.383789 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.383875 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 11:03:02.383988 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 11:03:02.384070 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.384446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] command line args: [] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 11:03:02.384536 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.384735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 11:03:02.384815 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] role.caching = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.384915 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ================================================================================ {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 11:03:02.384994 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] role.driver = sql {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.385174 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] admin_token = **** {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.385262 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.385422 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] config_dir = [] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.385503 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.385612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.385692 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.385856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] config_source = [] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.385980 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.386062 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] debug = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.386164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.386244 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.386405 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.386486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.386589 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.386700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.386843 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.386925 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.387093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.387173 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.387365 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] list_limit = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.387459 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.387533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] log_config_append = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.387690 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.387773 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.387860 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.387954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] log_dir = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.388030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] log_file = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.388112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.388263 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.388364 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.388513 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.388775 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.388854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.389026 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.389108 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.389213 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.389292 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.389394 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.389517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.389679 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.389808 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.390072 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.390203 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.390295 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.390492 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.390698 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.390812 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.391030 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.391125 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.391212 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.391338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.391476 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.391670 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.391761 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.391963 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.392090 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.392227 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.392384 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.392473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.392725 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.392886 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.392969 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.393189 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.393552 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] token.caching = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.393775 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.393775 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] publish_errors = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.394107 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.394419 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.394549 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.394549 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.394822 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.394822 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.395413 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.395413 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.395670 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.395787 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.395924 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.396084 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.396084 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.396325 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] standard_threads = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.396458 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.396571 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.396739 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.396855 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.397007 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.397123 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.397123 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] use_journal = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.397362 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.397489 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] use_json = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.397642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.397759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] use_stderr = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.397759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] use_syslog = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.398024 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.398140 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 11:03:02.398403 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.398403 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.398668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.398668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.398872 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.400502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.400687 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.connection = **** {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.400823 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.400993 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.401116 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.401270 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.401385 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.401497 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.401665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.401781 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.401893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.402014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.402097 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.402331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.402469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.403110 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.403110 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.403627 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.403627 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.404047 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.404351 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.404617 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.404805 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.405004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.405164 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.405448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.405448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.405965 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.406125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.406312 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.406579 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.406769 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.407052 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.407250 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.407483 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.407764 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.408036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.408315 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.408556 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 11:03:02.408690 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.408690 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.408690 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.408690 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.408690 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.408690 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.408690 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.408690 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.408690 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.410662 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.410662 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.410662 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.410662 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.410662 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.410662 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.410662 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.410662 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.410662 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.412197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.412197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.412197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.412197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.412197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.412197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.412197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.412197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.412197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.413956 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.413956 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.413956 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.413956 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.413956 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.413956 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.413956 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.413956 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.413956 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.416667 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.416667 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.416667 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.416667 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.416667 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.416667 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.416667 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.416667 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.416667 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.418670 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.418670 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.418670 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.418670 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.418670 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.418670 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.418670 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.418670 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.418670 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.420566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.420566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.420566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.420566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.420566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.420566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.420566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.420566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.420566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.422265 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.422265 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.422265 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.422265 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.422265 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.422265 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.422265 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.422265 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.422265 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.423958 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.423958 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.423958 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.423958 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.423958 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.423958 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.423958 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.423958 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.423958 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.425836 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.425836 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.425836 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] auth.external = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.425836 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.425836 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.425836 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.425836 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] auth.password = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.425836 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] auth.token = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.425836 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.427756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.427756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.427756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.427756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.427756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.427756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.427756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] credential.caching = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.427756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.427756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.429533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.429533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.429533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.429533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.429533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.429533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.429533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.429533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.429533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.431429 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.431429 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.431429 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.431429 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.431429 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] federation.caching = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.431429 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.431429 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.431429 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.431429 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.433270 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.433270 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.433270 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.433270 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.433270 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.433270 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.433270 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.433270 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] identity.caching = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.435035 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.435196 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.435493 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.435769 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.436032 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.436206 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.436206 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.436206 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.436206 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.436206 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.436206 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.436206 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.436206 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.436206 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.438069 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.438069 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.438069 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.438069 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.438069 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.438069 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.438069 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.438069 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.438069 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.439866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.439866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.439866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.439866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.439866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.439866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.439866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.439866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.441479 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.441479 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.441479 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.441479 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.441479 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.441479 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.441479 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.442888 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.442888 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.442888 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.443715 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.444000 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.444000 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.444000 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.444000 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.444000 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.444000 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.444000 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.444000 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.445545 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.445545 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.445545 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.445545 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.445545 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.user = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.445545 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.446788 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.446788 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.446788 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.446788 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.446788 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.447861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.447861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.447861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.447861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.447861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.448880 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.448880 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.448880 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.448880 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.449700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.449700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.449700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.450359 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.450359 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.450359 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.450864 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.450864 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.450864 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.451628 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.451628 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.451628 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.452179 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.452179 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.452781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.452781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.452781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.453384 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.453384 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.453800 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.453800 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.454269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] resource.caching = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.454269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.454507 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.454737 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.454923 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.455098 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.455382 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.455641 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.455913 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.456132 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.456368 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] role.caching = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.456623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] role.driver = sql {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.456908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.457111 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.457366 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.457621 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.457903 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.458123 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.458375 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.458626 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.458889 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.459125 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.459401 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.459652 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.459904 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.460153 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.460600 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.460846 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.461103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.461357 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.462147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.462403 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.462643 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.462904 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.463163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.463426 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.463666 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.463903 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.464142 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.464399 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.464662 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.464917 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.465168 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.465406 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.465638 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.465879 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] token.caching = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.466123 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.466382 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.466623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.466886 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.467135 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.467403 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.467652 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.467897 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.468149 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.468393 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.468636 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.468875 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.469126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.469382 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.469616 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.469865 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.470190 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.470455 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.connection = **** {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.470711 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.470962 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.471207 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.471501 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.471746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.471991 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.472234 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.472486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.472660 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.472748 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.472899 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.472991 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.473204 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.473442 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.473697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.473939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.474186 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.474420 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.474665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.474905 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 11:03:02.475079 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 11:03:02.502513 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.502791 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.502938 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.513028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.527770 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.531857 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.532090 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.572626 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.580289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.580525 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.608756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.608997 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.649195 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.649417 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.649627 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.649846 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.650067 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.650282 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.654597 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.654828 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.655058 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.655291 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.655519 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.655743 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.675689 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.675945 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.676136 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.676367 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.676591 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.676810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.677030 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.677878 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.678119 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.678349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.678574 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.678792 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.679007 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.679223 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.689667 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.691065 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.703625 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.703852 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.703993 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.704127 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.704213 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.704380 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.704468 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.704623 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.704708 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.704803 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.704882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.705036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.705143 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.705223 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 11:03:02.723323 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.723557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 11:03:02.723646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.723834 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 11:03:02.723939 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.724050 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 11:03:02.724189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.724313 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.724404 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 11:03:02.724576 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.724679 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.724836 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.724926 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.725102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.725206 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.725391 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.736071 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.736071 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.736522 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.736604 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.736744 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.736837 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.737018 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.737311 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.745213 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.746596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.748459 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.748747 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.749059 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.749441 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.749684 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.749779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.749978 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.750067 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.750262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.750350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.750536 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.750647 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.750807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.750922 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.751073 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.751165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.751373 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.751482 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.751657 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.751932 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.752207 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.752477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.775633 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.776099 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.777136 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.777421 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.777671 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.777965 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.782287 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.782598 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.782699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.782955 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.783050 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.783378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.790448 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.790662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.790746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.790909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.795146 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.795343 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.795445 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.795535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.795741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.795840 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.796075 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.796243 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.796342 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.796512 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.796610 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.796766 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.796893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.796991 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.797120 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.797252 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.813943 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.814143 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.814230 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.814342 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.818200 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.818326 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.821422 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.821554 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.821717 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.821942 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.826201 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.826446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.829421 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.829667 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.832625 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.832924 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.833148 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.833257 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.833448 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.833591 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.833753 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.833868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.834037 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.834148 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.834321 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.834603 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.850230 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.850529 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.850800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.851066 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.852755 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.853099 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.853329 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.853595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.858556 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.860312 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.860592 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.860816 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.862413 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.862703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.863328 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.863620 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.863906 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.864189 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.864472 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.865610 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.865894 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.866179 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.866463 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.866753 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.876638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.876928 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.877214 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.877496 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.877779 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.878053 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.878339 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.879001 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.879314 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.879600 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.879881 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.880170 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.880447 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.880720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.897710 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.901331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.904763 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.905518 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.907026 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.908582 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.908733 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.908849 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.909134 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.912365 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.914310 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.916159 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.916489 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.916823 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.924689 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.926752 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.930486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.930857 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.931199 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.931557 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.941758 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.942108 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.942457 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.951860 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:02.952209 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.952529 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.952825 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.953148 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.953455 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.953774 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.954092 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.954572 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.954889 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.955224 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.955568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.955875 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.956171 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:02.996623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b2aec359c0 pid: 87206 (default app) Jul 28 11:03:03.001002 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e07a79-0604-471f-bfb8-5878566d0fa9 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:03.001341 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e07a79-0604-471f-bfb8-5878566d0fa9 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:03.001690 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e07a79-0604-471f-bfb8-5878566d0fa9 None None] PATH_INFO: `/v3` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:03.006876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 791 bytes} [Thu Jul 28 11:03:02 2022] GET /identity/v3/ => generated 255 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:03.017430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.018913 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:03.021860 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.022149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.022436 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.022722 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.031797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:03.031963 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.032205 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.039309 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 11:03:03.039737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.040034 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.040310 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.040585 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.040875 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.041156 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.041435 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.041714 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.041985 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.042263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.042526 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.042796 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.043058 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 11:03:03.077218 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b2aec359c0 pid: 87205 (default app) Jul 28 11:03:11.410955 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d2f1-5923-45d1-a20b-2371687b68ec None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:11.411540 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d2f1-5923-45d1-a20b-2371687b68ec None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:11.411540 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d2f1-5923-45d1-a20b-2371687b68ec None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:11.412886 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 2/2] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:03:11.421471 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8d031-1e31-4c79-bd05-bebf7e0b9f93 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:11.421994 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8d031-1e31-4c79-bd05-bebf7e0b9f93 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:11.422087 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8d031-1e31-4c79-bd05-bebf7e0b9f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:11.499233 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: INFO dbcounter [None req-94a8d031-1e31-4c79-bd05-bebf7e0b9f93 None None] Registered counter for database keystone Jul 28 11:03:11.521241 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG oslo_db.sqlalchemy.engines [None req-94a8d031-1e31-4c79-bd05-bebf7e0b9f93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87205) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 11:03:11.528205 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writer thread running {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 11:03:11.719953 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG passlib.handlers.bcrypt [None req-94a8d031-1e31-4c79-bd05-bebf7e0b9f93 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87205) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 11:03:11.720629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG passlib.handlers.bcrypt [None req-94a8d031-1e31-4c79-bd05-bebf7e0b9f93 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87205) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 11:03:11.780010 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-94a8d031-1e31-4c79-bd05-bebf7e0b9f93 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:11.781655 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-94a8d031-1e31-4c79-bd05-bebf7e0b9f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:11.918499 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 1/3] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 28 11:03:12.052975 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59d2f1-5923-45d1-a20b-2371687b68ec None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:12.129747 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: INFO dbcounter [None req-af59d2f1-5923-45d1-a20b-2371687b68ec None None] Registered counter for database keystone Jul 28 11:03:12.150351 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG oslo_db.sqlalchemy.engines [None req-af59d2f1-5923-45d1-a20b-2371687b68ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87206) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 11:03:12.157292 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writer thread running {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 11:03:12.380423 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59d2f1-5923-45d1-a20b-2371687b68ec None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:12.385780 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629035bc-d859-49a3-9a5a-61caaad9933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:12.386429 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629035bc-d859-49a3-9a5a-61caaad9933a admin admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:12.386718 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629035bc-d859-49a3-9a5a-61caaad9933a admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:12.387000 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629035bc-d859-49a3-9a5a-61caaad9933a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:12.396289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629035bc-d859-49a3-9a5a-61caaad9933a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:12.447039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: WARNING keystone.common.rbac_enforcer.enforcer [None req-629035bc-d859-49a3-9a5a-61caaad9933a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 11:03:12.447717 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629035bc-d859-49a3-9a5a-61caaad9933a admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:12.457900 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 3/4] 10.222.0.71 () {58 vars in 1324 bytes} [Thu Jul 28 11:03:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 11:03:12.464119 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8d031-1e31-4c79-bd05-bebf7e0b9f93 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:12.479655 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8d031-1e31-4c79-bd05-bebf7e0b9f93 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:12.484182 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd281665-c9fa-4148-9794-72c78c87e0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:12.485360 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd281665-c9fa-4148-9794-72c78c87e0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:12.485648 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd281665-c9fa-4148-9794-72c78c87e0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:12.485929 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd281665-c9fa-4148-9794-72c78c87e0f8 admin admin] PATH_INFO: `/v3/projects/584d842f145544c78397d7b263b77dae` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:12.487652 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd281665-c9fa-4148-9794-72c78c87e0f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=584d842f145544c78397d7b263b77dae)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:12.537693 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bd281665-c9fa-4148-9794-72c78c87e0f8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 11:03:12.538040 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd281665-c9fa-4148-9794-72c78c87e0f8 admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:12.543343 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 2/5] 10.222.0.71 () {56 vars in 1207 bytes} [Thu Jul 28 11:03:12 2022] GET /identity/v3/projects/584d842f145544c78397d7b263b77dae => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:14.788154 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711c59c-05e0-4c9a-8c52-31c60c58b0e9 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:14.788673 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711c59c-05e0-4c9a-8c52-31c60c58b0e9 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:14.789052 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711c59c-05e0-4c9a-8c52-31c60c58b0e9 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:14.795070 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 4/6] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:14.801082 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078c28f-4b55-4b65-a889-a3b4e3399d63 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:14.801513 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078c28f-4b55-4b65-a889-a3b4e3399d63 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:14.801645 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078c28f-4b55-4b65-a889-a3b4e3399d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:14.822551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-c078c28f-4b55-4b65-a889-a3b4e3399d63 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:14.824143 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-c078c28f-4b55-4b65-a889-a3b4e3399d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:14.832253 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 3/7] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 28 11:03:14.856241 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711c59c-05e0-4c9a-8c52-31c60c58b0e9 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:14.868877 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711c59c-05e0-4c9a-8c52-31c60c58b0e9 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:14.873081 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ca411-1f69-42e4-80f2-8d6d32c2be7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:14.873696 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ca411-1f69-42e4-80f2-8d6d32c2be7c admin admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:14.873982 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ca411-1f69-42e4-80f2-8d6d32c2be7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:14.874262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ca411-1f69-42e4-80f2-8d6d32c2be7c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:14.884147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ca411-1f69-42e4-80f2-8d6d32c2be7c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:14.886249 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ca411-1f69-42e4-80f2-8d6d32c2be7c admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:14.895628 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 5/8] 10.222.0.71 () {58 vars in 1324 bytes} [Thu Jul 28 11:03:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 11:03:14.901974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078c28f-4b55-4b65-a889-a3b4e3399d63 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:14.911657 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078c28f-4b55-4b65-a889-a3b4e3399d63 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:14.916279 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc34ff4-57ec-4b43-9dd7-4ebad47b3e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:14.916988 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc34ff4-57ec-4b43-9dd7-4ebad47b3e3b admin admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:14.917279 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc34ff4-57ec-4b43-9dd7-4ebad47b3e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:14.917564 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc34ff4-57ec-4b43-9dd7-4ebad47b3e3b admin admin] PATH_INFO: `/v3/users/5277cece91a843118766eb0b5a214210` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:14.918961 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc34ff4-57ec-4b43-9dd7-4ebad47b3e3b admin admin] RBAC: Authorizing `identity:get_user(user_id=5277cece91a843118766eb0b5a214210)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:14.920868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc34ff4-57ec-4b43-9dd7-4ebad47b3e3b admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:14.922473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 4/9] 10.222.0.71 () {56 vars in 1198 bytes} [Thu Jul 28 11:03:14 2022] GET /identity/v3/users/5277cece91a843118766eb0b5a214210 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:03:17.250337 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c6048-fe96-4e86-86c8-73ee3ef075d4 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:17.250995 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c6048-fe96-4e86-86c8-73ee3ef075d4 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:17.250995 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c6048-fe96-4e86-86c8-73ee3ef075d4 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:17.252254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 6/10] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:03:17.260949 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc990c1-b759-4307-802d-49071c177e4f None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:17.261886 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc990c1-b759-4307-802d-49071c177e4f None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:17.261886 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc990c1-b759-4307-802d-49071c177e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:17.282179 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-3fc990c1-b759-4307-802d-49071c177e4f None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:17.283422 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-3fc990c1-b759-4307-802d-49071c177e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:17.369446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa5814-1417-4033-9e54-b0cc22adca05 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:17.369724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa5814-1417-4033-9e54-b0cc22adca05 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:17.370001 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa5814-1417-4033-9e54-b0cc22adca05 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:17.371395 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 7/11] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:03:17.377169 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aba87e-f5ae-477b-9d7f-0fa2922dce43 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:17.377546 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aba87e-f5ae-477b-9d7f-0fa2922dce43 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:17.377829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aba87e-f5ae-477b-9d7f-0fa2922dce43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:17.408123 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 5/12] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:03:17.432787 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG passlib.handlers.bcrypt [None req-c2aba87e-f5ae-477b-9d7f-0fa2922dce43 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87206) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 11:03:17.432985 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc990c1-b759-4307-802d-49071c177e4f None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:17.433215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG passlib.handlers.bcrypt [None req-c2aba87e-f5ae-477b-9d7f-0fa2922dce43 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87206) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 11:03:17.457460 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:17.480087 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-c2aba87e-f5ae-477b-9d7f-0fa2922dce43 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:17.481786 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-c2aba87e-f5ae-477b-9d7f-0fa2922dce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:17.549813 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc990c1-b759-4307-802d-49071c177e4f None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:17.594528 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728f947-5038-43ed-8bee-d3bca586e3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:17.595323 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728f947-5038-43ed-8bee-d3bca586e3e1 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:17.595599 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728f947-5038-43ed-8bee-d3bca586e3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:17.595877 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728f947-5038-43ed-8bee-d3bca586e3e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:17.608497 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728f947-5038-43ed-8bee-d3bca586e3e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:17.617501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-1728f947-5038-43ed-8bee-d3bca586e3e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:03:17.617501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:17.617501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:17.617501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:17.617501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:17.617501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:17.617501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:17.617501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:17.617501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:17.617501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:17.617501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:17.617501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:17.617501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:17.617501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:17.617501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:17.617501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:17.618477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:17.618477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:17.618477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:17.618477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:17.618477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:17.618477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:17.618477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:17.618477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:17.618477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:17.618477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:17.618477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:17.618477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:17.618477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:17.618477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:17.618477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:17.618477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:17.619249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:17.619249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:17.619249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:17.619249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:17.619249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:17.619249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:17.619249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:17.619249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:17.619249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:17.619249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:17.619249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:03:17.619249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:03:17.619249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 6/13] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Jul 28 11:03:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:03:17.621843 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 8/14] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:03:17.626546 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728f947-5038-43ed-8bee-d3bca586e3e1 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:17.645741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aba87e-f5ae-477b-9d7f-0fa2922dce43 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:17.743950 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:17.755681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aba87e-f5ae-477b-9d7f-0fa2922dce43 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:17.758152 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:17.766114 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728f947-5038-43ed-8bee-d3bca586e3e1 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:17.804130 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce6749-ac71-46a0-9000-e5961d5207cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:17.805848 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce6749-ac71-46a0-9000-e5961d5207cf None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:17.806137 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce6749-ac71-46a0-9000-e5961d5207cf None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:17.806411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce6749-ac71-46a0-9000-e5961d5207cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:17.807887 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d61ef-68bf-4e5b-9d11-ff01ce9b1bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:17.808519 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d61ef-68bf-4e5b-9d11-ff01ce9b1bb3 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:17.808802 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d61ef-68bf-4e5b-9d11-ff01ce9b1bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:17.809080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d61ef-68bf-4e5b-9d11-ff01ce9b1bb3 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:17.809818 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d61ef-68bf-4e5b-9d11-ff01ce9b1bb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:17.810126 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d61ef-68bf-4e5b-9d11-ff01ce9b1bb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:17.811567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d61ef-68bf-4e5b-9d11-ff01ce9b1bb3 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:17.823995 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 7/15] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:17.831418 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d61ef-68bf-4e5b-9d11-ff01ce9b1bb3 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:17.899284 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce6749-ac71-46a0-9000-e5961d5207cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:17.900835 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce6749-ac71-46a0-9000-e5961d5207cf None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:17.939494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d61ef-68bf-4e5b-9d11-ff01ce9b1bb3 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:17.975688 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b1763-c614-49b1-84ed-0d5704a9ec8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:17.976452 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b1763-c614-49b1-84ed-0d5704a9ec8e None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:17.976810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b1763-c614-49b1-84ed-0d5704a9ec8e None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:17.977114 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b1763-c614-49b1-84ed-0d5704a9ec8e None admin] PATH_INFO: `/v3/users/5277cece91a843118766eb0b5a214210` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:17.978339 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b1763-c614-49b1-84ed-0d5704a9ec8e None admin] RBAC: Authorizing `identity:get_user(user_id=5277cece91a843118766eb0b5a214210)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:17.979857 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b1763-c614-49b1-84ed-0d5704a9ec8e None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:17.981507 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 8/16] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:17 2022] GET /identity/v3/users/5277cece91a843118766eb0b5a214210 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:03:17.987528 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b1763-c614-49b1-84ed-0d5704a9ec8e None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:18.009126 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:18.014394 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 9/17] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 11:03:18.020326 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce6749-ac71-46a0-9000-e5961d5207cf None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:18.024782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:18.103523 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b1763-c614-49b1-84ed-0d5704a9ec8e None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:18.129251 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce6749-ac71-46a0-9000-e5961d5207cf None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:18.145021 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca05287-3ed9-4324-a16c-d2eff3dd8b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:18.145686 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca05287-3ed9-4324-a16c-d2eff3dd8b3b None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:18.145962 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca05287-3ed9-4324-a16c-d2eff3dd8b3b None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:18.146240 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca05287-3ed9-4324-a16c-d2eff3dd8b3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:18.147492 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca05287-3ed9-4324-a16c-d2eff3dd8b3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:18.148978 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca05287-3ed9-4324-a16c-d2eff3dd8b3b None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:18.150554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 9/18] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:03:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:03:18.156420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca05287-3ed9-4324-a16c-d2eff3dd8b3b None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:18.185109 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5905ad3-723a-484f-9e3b-dac37b0139bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:18.186680 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5905ad3-723a-484f-9e3b-dac37b0139bd None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:18.187215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5905ad3-723a-484f-9e3b-dac37b0139bd None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:18.187784 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5905ad3-723a-484f-9e3b-dac37b0139bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:18.224036 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5905ad3-723a-484f-9e3b-dac37b0139bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:18.226995 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5905ad3-723a-484f-9e3b-dac37b0139bd None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:18.237434 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:18.252649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-e5905ad3-723a-484f-9e3b-dac37b0139bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:03:18.252649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:18.252649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:18.252649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:18.252649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:18.252649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:18.252649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:18.252649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:18.252649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:18.252649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:18.252649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:18.252649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:18.252649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:03:18.252649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:03:18.252649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:03:18.256165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:03:18.256165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:18.256165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:18.256165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:18.256165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:18.256165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:18.256165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:18.256165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:18.256165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:18.256165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:18.256165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:18.256165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:18.256165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:18.256165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:18.256165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:18.256165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:18.256165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:18.256940 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:03:18.256940 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:03:18.256940 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:03:18.256940 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:03:18.256940 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 10/19] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:03:18.259011 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca05287-3ed9-4324-a16c-d2eff3dd8b3b None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:18.262674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5905ad3-723a-484f-9e3b-dac37b0139bd None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:18.298172 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1269a7c-e095-426e-b6ed-b296361d2778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:18.298853 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1269a7c-e095-426e-b6ed-b296361d2778 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:18.299078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1269a7c-e095-426e-b6ed-b296361d2778 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:18.299383 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1269a7c-e095-426e-b6ed-b296361d2778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:18.303738 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1269a7c-e095-426e-b6ed-b296361d2778 None admin] RBAC: Adding query filter params (role.id=f2a8452a65264f9ea10467160b1bd735, scope.domain.id=default, user.id=5277cece91a843118766eb0b5a214210) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:18.303738 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1269a7c-e095-426e-b6ed-b296361d2778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:18.303738 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1269a7c-e095-426e-b6ed-b296361d2778 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:18.310159 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 10/20] 10.222.0.71 () {56 vars in 1322 bytes} [Thu Jul 28 11:03:18 2022] GET /identity/v3/role_assignments?user.id=5277cece91a843118766eb0b5a214210&scope.domain.id=default&role.id=f2a8452a65264f9ea10467160b1bd735 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:03:18.327355 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:18.394687 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5905ad3-723a-484f-9e3b-dac37b0139bd None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:18.460555 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f3895-5c26-4852-aba5-cae63126981d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:18.460555 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f3895-5c26-4852-aba5-cae63126981d None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:18.461146 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f3895-5c26-4852-aba5-cae63126981d None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:18.462030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f3895-5c26-4852-aba5-cae63126981d None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:18.463196 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f3895-5c26-4852-aba5-cae63126981d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:18.463701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f3895-5c26-4852-aba5-cae63126981d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:18.466295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f3895-5c26-4852-aba5-cae63126981d None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:18.502610 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 11/21] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:03:21.354510 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc876ea-8c22-4660-a427-8821e36efb43 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:21.354510 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc876ea-8c22-4660-a427-8821e36efb43 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:21.354510 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc876ea-8c22-4660-a427-8821e36efb43 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:21.354510 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 11/22] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:21.360854 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9422db-273a-4339-b6ea-83b5008d8a88 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:21.361371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9422db-273a-4339-b6ea-83b5008d8a88 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:21.361443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9422db-273a-4339-b6ea-83b5008d8a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:21.404359 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-3e9422db-273a-4339-b6ea-83b5008d8a88 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:21.405592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-3e9422db-273a-4339-b6ea-83b5008d8a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:21.550013 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d9d2f-cdeb-4d79-b27a-846acd9774b3 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:21.550202 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 12/23] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:21.550744 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d9d2f-cdeb-4d79-b27a-846acd9774b3 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:21.551286 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d9d2f-cdeb-4d79-b27a-846acd9774b3 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:21.552894 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 12/24] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:21.584868 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b4427-79d4-48d2-8250-5e06087be11c None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:21.585199 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b4427-79d4-48d2-8250-5e06087be11c None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:21.585450 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b4427-79d4-48d2-8250-5e06087be11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:21.600293 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d9d2f-cdeb-4d79-b27a-846acd9774b3 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:21.628571 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-9b5b4427-79d4-48d2-8250-5e06087be11c None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:21.638952 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-9b5b4427-79d4-48d2-8250-5e06087be11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:21.770345 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:21.848323 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 13/25] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:03:21.884182 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b4427-79d4-48d2-8250-5e06087be11c None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:21.895958 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d9d2f-cdeb-4d79-b27a-846acd9774b3 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:21.956644 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b2f57-fc2e-4418-a92b-29f5a047c4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:21.957521 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b2f57-fc2e-4418-a92b-29f5a047c4d0 None admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:21.957965 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b2f57-fc2e-4418-a92b-29f5a047c4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:21.958403 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b2f57-fc2e-4418-a92b-29f5a047c4d0 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:21.959284 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b2f57-fc2e-4418-a92b-29f5a047c4d0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:21.960922 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b2f57-fc2e-4418-a92b-29f5a047c4d0 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:22.148198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b4427-79d4-48d2-8250-5e06087be11c None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:22.167781 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 13/26] 10.222.0.71 () {60 vars in 1131 bytes} [Thu Jul 28 11:03:21 2022] POST /identity/v3/roles => generated 219 bytes in 568 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:03:22.169317 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa694a-918e-47e7-8162-3d328e4e757f None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:22.169618 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa694a-918e-47e7-8162-3d328e4e757f None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:22.169903 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa694a-918e-47e7-8162-3d328e4e757f None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:22.171199 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 14/27] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:22.179022 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17cbaa-ee03-4cb1-b30f-c95245b0fed4 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:22.179410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17cbaa-ee03-4cb1-b30f-c95245b0fed4 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:22.179665 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17cbaa-ee03-4cb1-b30f-c95245b0fed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:22.200153 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:22.217045 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-cd17cbaa-ee03-4cb1-b30f-c95245b0fed4 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:22.218828 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-cd17cbaa-ee03-4cb1-b30f-c95245b0fed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:22.241464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b855b5d-31f4-4b82-8130-2e4437ba7090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:22.242652 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b855b5d-31f4-4b82-8130-2e4437ba7090 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:22.243120 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b855b5d-31f4-4b82-8130-2e4437ba7090 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:22.243446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b855b5d-31f4-4b82-8130-2e4437ba7090 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:22.276323 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b855b5d-31f4-4b82-8130-2e4437ba7090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:22.284340 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-9b855b5d-31f4-4b82-8130-2e4437ba7090 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:03:22.284340 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:22.284340 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:22.284340 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:22.284340 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:22.284340 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:22.284340 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:22.284340 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:22.284340 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:22.284340 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:22.284340 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:22.284340 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:22.284340 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:22.284340 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:22.284340 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:22.284340 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:22.285336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:22.285336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:22.285336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:22.285336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:22.285336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:22.285336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:22.285336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:22.285336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:22.285336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:22.285336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:22.285336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:22.285336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:22.285336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:22.285336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:22.285336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:22.285336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:22.286086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:22.286086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:22.286086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:22.286086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:22.286086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:22.286086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:22.286086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:22.286086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:22.286086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:22.286086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:22.286086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:03:22.286086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:03:22.289957 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 14/28] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Jul 28 11:03:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:22.298406 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b855b5d-31f4-4b82-8130-2e4437ba7090 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:22.407319 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:22.410431 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 15/29] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:22.413689 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dea28-d358-4bb7-91fe-3fc1bd8af29f None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:22.414219 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dea28-d358-4bb7-91fe-3fc1bd8af29f None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:22.415231 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dea28-d358-4bb7-91fe-3fc1bd8af29f None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:22.417779 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 16/30] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:22.443379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf114429-2c21-4087-8b40-fc23f0e76e11 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:22.443777 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf114429-2c21-4087-8b40-fc23f0e76e11 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:22.444053 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf114429-2c21-4087-8b40-fc23f0e76e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:22.478763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-cf114429-2c21-4087-8b40-fc23f0e76e11 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:22.480092 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-cf114429-2c21-4087-8b40-fc23f0e76e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:22.539045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b855b5d-31f4-4b82-8130-2e4437ba7090 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:22.569640 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 17/31] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:03:22.570852 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf114429-2c21-4087-8b40-fc23f0e76e11 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:22.585320 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b728b-4251-4625-b4ff-94d90e940af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:22.587128 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b728b-4251-4625-b4ff-94d90e940af5 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:22.587482 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b728b-4251-4625-b4ff-94d90e940af5 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:22.587764 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b728b-4251-4625-b4ff-94d90e940af5 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:22.588508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b728b-4251-4625-b4ff-94d90e940af5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:22.588820 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b728b-4251-4625-b4ff-94d90e940af5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:22.590262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b728b-4251-4625-b4ff-94d90e940af5 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:22.615721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 15/32] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:22.618162 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b728b-4251-4625-b4ff-94d90e940af5 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:22.670897 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:22.752836 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf114429-2c21-4087-8b40-fc23f0e76e11 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:22.780665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:22.786171 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b728b-4251-4625-b4ff-94d90e940af5 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:22.824514 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70273eb-eb66-4f84-834a-1fcaaf8ba397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:22.825943 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70273eb-eb66-4f84-834a-1fcaaf8ba397 None admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:22.826522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70273eb-eb66-4f84-834a-1fcaaf8ba397 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:22.827044 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70273eb-eb66-4f84-834a-1fcaaf8ba397 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:22.827643 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175effe3-14a3-4c58-a2bf-4c8389ddc4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:22.828574 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175effe3-14a3-4c58-a2bf-4c8389ddc4d2 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:22.828692 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70273eb-eb66-4f84-834a-1fcaaf8ba397 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:22.829169 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175effe3-14a3-4c58-a2bf-4c8389ddc4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:22.829641 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175effe3-14a3-4c58-a2bf-4c8389ddc4d2 None admin] PATH_INFO: `/v3/users/5277cece91a843118766eb0b5a214210` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:22.831672 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175effe3-14a3-4c58-a2bf-4c8389ddc4d2 None admin] RBAC: Authorizing `identity:get_user(user_id=5277cece91a843118766eb0b5a214210)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:22.831806 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70273eb-eb66-4f84-834a-1fcaaf8ba397 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:22.833569 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175effe3-14a3-4c58-a2bf-4c8389ddc4d2 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:22.835646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 16/33] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:22 2022] GET /identity/v3/users/5277cece91a843118766eb0b5a214210 => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:22.837281 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175effe3-14a3-4c58-a2bf-4c8389ddc4d2 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:22.879306 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 18/34] 10.222.0.71 () {60 vars in 1131 bytes} [Thu Jul 28 11:03:22 2022] POST /identity/v3/roles => generated 225 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:03:22.879306 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70273eb-eb66-4f84-834a-1fcaaf8ba397 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:23.033585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175effe3-14a3-4c58-a2bf-4c8389ddc4d2 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:23.080471 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a2484-451a-4ec3-94e9-dbbb22eda0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:23.081217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a2484-451a-4ec3-94e9-dbbb22eda0fd None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:23.081498 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a2484-451a-4ec3-94e9-dbbb22eda0fd None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:23.081773 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a2484-451a-4ec3-94e9-dbbb22eda0fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:23.105547 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a2484-451a-4ec3-94e9-dbbb22eda0fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:23.108056 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a2484-451a-4ec3-94e9-dbbb22eda0fd None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:23.116162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70273eb-eb66-4f84-834a-1fcaaf8ba397 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:23.132280 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-e90a2484-451a-4ec3-94e9-dbbb22eda0fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:03:23.132280 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:23.132280 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:23.132280 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:23.132280 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:23.132280 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:23.132280 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:23.132280 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:23.132280 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:23.132280 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:23.132280 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:23.132280 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:23.132280 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:03:23.132280 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:03:23.132280 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:03:23.133668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:03:23.133668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:23.133668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:23.133668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:23.133668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:23.133668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:23.133668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:23.133668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:23.133668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:23.133668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:23.133668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:23.133668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:23.133668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:23.133668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:23.133668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:23.133668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:23.133668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:23.134451 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:03:23.134451 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:03:23.134451 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:03:23.134451 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:03:23.134451 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 17/35] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:23.139728 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb6230-6d8a-426b-a5d0-075c3f192f57 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:23.140335 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb6230-6d8a-426b-a5d0-075c3f192f57 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:23.140807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb6230-6d8a-426b-a5d0-075c3f192f57 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:23.142715 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 18/36] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:23.143733 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb6230-6d8a-426b-a5d0-075c3f192f57 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:23.149245 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:23.166612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:23.167127 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969443e3-0d69-48ae-b47f-258374736d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:23.167986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969443e3-0d69-48ae-b47f-258374736d19 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:23.168318 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969443e3-0d69-48ae-b47f-258374736d19 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:23.168625 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969443e3-0d69-48ae-b47f-258374736d19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:23.169925 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969443e3-0d69-48ae-b47f-258374736d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:23.171652 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969443e3-0d69-48ae-b47f-258374736d19 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:23.173491 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 19/37] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:03:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:23.174914 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fe28b-8bc0-478b-8f96-ffe34375d1cb None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:23.174914 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fe28b-8bc0-478b-8f96-ffe34375d1cb None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:23.175096 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fe28b-8bc0-478b-8f96-ffe34375d1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:23.210051 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-0a2fe28b-8bc0-478b-8f96-ffe34375d1cb None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:23.212225 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-0a2fe28b-8bc0-478b-8f96-ffe34375d1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:23.295469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb6230-6d8a-426b-a5d0-075c3f192f57 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:23.307359 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 20/38] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:23.307359 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fe28b-8bc0-478b-8f96-ffe34375d1cb None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:23.354044 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b24e2-8b29-41d7-863d-8200166e339b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:23.355410 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b24e2-8b29-41d7-863d-8200166e339b None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:23.355717 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b24e2-8b29-41d7-863d-8200166e339b None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:23.356069 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b24e2-8b29-41d7-863d-8200166e339b None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:23.356807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b24e2-8b29-41d7-863d-8200166e339b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:23.357175 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b24e2-8b29-41d7-863d-8200166e339b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:23.359485 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b24e2-8b29-41d7-863d-8200166e339b None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:23.377508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 19/39] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:23.378367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b24e2-8b29-41d7-863d-8200166e339b None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:23.431029 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fe28b-8bc0-478b-8f96-ffe34375d1cb None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:23.460007 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:23.474320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c62eb4-441d-4cb4-acf0-15d5f05b6975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:23.475017 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c62eb4-441d-4cb4-acf0-15d5f05b6975 None admin] REQUEST_METHOD: `PUT` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:23.475334 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c62eb4-441d-4cb4-acf0-15d5f05b6975 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:23.475631 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c62eb4-441d-4cb4-acf0-15d5f05b6975 None admin] PATH_INFO: `/v3/domains/default/users/5277cece91a843118766eb0b5a214210/roles/f2a8452a65264f9ea10467160b1bd735` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:23.478270 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c62eb4-441d-4cb4-acf0-15d5f05b6975 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5277cece91a843118766eb0b5a214210, role_id=f2a8452a65264f9ea10467160b1bd735)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:23.479837 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c62eb4-441d-4cb4-acf0-15d5f05b6975 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:23.481518 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:23.495513 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 21/40] 10.222.0.71 () {58 vars in 1361 bytes} [Thu Jul 28 11:03:23 2022] PUT /identity/v3/domains/default/users/5277cece91a843118766eb0b5a214210/roles/f2a8452a65264f9ea10467160b1bd735 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:03:23.496409 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c62eb4-441d-4cb4-acf0-15d5f05b6975 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:23.510740 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b24e2-8b29-41d7-863d-8200166e339b None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:23.562311 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3efa5-5173-4fc4-8bbd-549c0eb2aa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:23.563390 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3efa5-5173-4fc4-8bbd-549c0eb2aa21 None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:23.563872 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3efa5-5173-4fc4-8bbd-549c0eb2aa21 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:23.564432 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3efa5-5173-4fc4-8bbd-549c0eb2aa21 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:23.565245 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3efa5-5173-4fc4-8bbd-549c0eb2aa21 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:23.569225 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3efa5-5173-4fc4-8bbd-549c0eb2aa21 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:23.647149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c62eb4-441d-4cb4-acf0-15d5f05b6975 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:23.697745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a8454-3411-4027-b8f9-e5a66405344d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:23.698398 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a8454-3411-4027-b8f9-e5a66405344d None admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:23.698689 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a8454-3411-4027-b8f9-e5a66405344d None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:23.699201 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a8454-3411-4027-b8f9-e5a66405344d None admin] PATH_INFO: `/v3/projects` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:23.699712 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a8454-3411-4027-b8f9-e5a66405344d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:23.701180 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a8454-3411-4027-b8f9-e5a66405344d None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:23.707736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 20/41] 10.222.0.71 () {60 vars in 1131 bytes} [Thu Jul 28 11:03:23 2022] POST /identity/v3/roles => generated 223 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:03:23.714331 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be911ebc-61d9-4f7f-a01d-bcbebf12db99 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:23.715040 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be911ebc-61d9-4f7f-a01d-bcbebf12db99 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:23.715597 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be911ebc-61d9-4f7f-a01d-bcbebf12db99 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:23.717824 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 21/42] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:23.729464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcd864-f0b7-4c83-a1c8-350b16c16737 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:23.729902 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcd864-f0b7-4c83-a1c8-350b16c16737 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:23.730867 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcd864-f0b7-4c83-a1c8-350b16c16737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:23.737879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 22/43] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Jul 28 11:03:23 2022] POST /identity/v3/projects => generated 301 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:03:23.756201 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-d7fcd864-f0b7-4c83-a1c8-350b16c16737 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:23.757951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-d7fcd864-f0b7-4c83-a1c8-350b16c16737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:23.865310 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 22/44] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:23.890175 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a8454-3411-4027-b8f9-e5a66405344d None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:23.933554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:24.019644 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a8454-3411-4027-b8f9-e5a66405344d None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:24.062781 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8314b8-ad80-4547-8313-670482417129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:24.063475 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8314b8-ad80-4547-8313-670482417129 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:24.063767 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8314b8-ad80-4547-8313-670482417129 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:24.064051 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8314b8-ad80-4547-8313-670482417129 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:24.065511 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8314b8-ad80-4547-8313-670482417129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:24.066997 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8314b8-ad80-4547-8313-670482417129 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:24.068708 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 23/45] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:03:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:24.074909 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcd864-f0b7-4c83-a1c8-350b16c16737 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:24.143816 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:24.177458 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcd864-f0b7-4c83-a1c8-350b16c16737 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:24.212505 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac632d76-e105-41ca-9c40-892e9c57a9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:24.213139 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac632d76-e105-41ca-9c40-892e9c57a9d0 None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:24.213431 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac632d76-e105-41ca-9c40-892e9c57a9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:24.213714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac632d76-e105-41ca-9c40-892e9c57a9d0 None admin] PATH_INFO: `/v3/projects` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:24.214417 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac632d76-e105-41ca-9c40-892e9c57a9d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:24.216049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac632d76-e105-41ca-9c40-892e9c57a9d0 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:24.244989 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 23/46] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Jul 28 11:03:24 2022] POST /identity/v3/projects => generated 312 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:03:25.753971 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2618e-4d4a-435d-bd08-3194cc1a9079 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:25.754453 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2618e-4d4a-435d-bd08-3194cc1a9079 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:25.754453 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2618e-4d4a-435d-bd08-3194cc1a9079 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:25.755894 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 24/47] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:25.761583 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ac9c7-32c5-4617-9bcf-291f02bad567 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:25.762027 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ac9c7-32c5-4617-9bcf-291f02bad567 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:25.762270 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ac9c7-32c5-4617-9bcf-291f02bad567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:25.780901 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-153ac9c7-32c5-4617-9bcf-291f02bad567 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:25.782097 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-153ac9c7-32c5-4617-9bcf-291f02bad567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:25.855614 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 24/48] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:25.879217 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2618e-4d4a-435d-bd08-3194cc1a9079 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:25.981983 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2618e-4d4a-435d-bd08-3194cc1a9079 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:25.983588 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:26.019010 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964f8e5-179e-4b0b-a2fe-c78ad9929730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:26.019605 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964f8e5-179e-4b0b-a2fe-c78ad9929730 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:26.019898 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964f8e5-179e-4b0b-a2fe-c78ad9929730 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:26.020184 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964f8e5-179e-4b0b-a2fe-c78ad9929730 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:26.031010 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964f8e5-179e-4b0b-a2fe-c78ad9929730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:26.036081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-f964f8e5-179e-4b0b-a2fe-c78ad9929730 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:03:26.036081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:26.036081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:26.036081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:26.036081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:26.036081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:26.036081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:26.036081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:26.036081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:26.036081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:26.036081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:26.036081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:26.036081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:26.036081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:26.036081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:26.036081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:26.036912 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:26.036912 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:26.036912 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:26.036912 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:26.036912 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:26.036912 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:26.036912 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:26.036912 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:26.036912 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:26.036912 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:26.036912 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:26.036912 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:26.036912 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:26.036912 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:26.036912 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:26.036912 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:26.037673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:26.037673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:26.037673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:26.037673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:26.037673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:26.037673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:26.037673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:26.037673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:26.037673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:26.037673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:26.037673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:03:26.037673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:03:26.037673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 25/49] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Jul 28 11:03:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:26.043700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ac9c7-32c5-4617-9bcf-291f02bad567 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:26.093578 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:26.145401 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ac9c7-32c5-4617-9bcf-291f02bad567 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:26.181493 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a080f-be42-4767-8502-18bee34f73d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:26.182122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a080f-be42-4767-8502-18bee34f73d4 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:26.182414 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a080f-be42-4767-8502-18bee34f73d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:26.182691 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a080f-be42-4767-8502-18bee34f73d4 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:26.183450 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a080f-be42-4767-8502-18bee34f73d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:26.183759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a080f-be42-4767-8502-18bee34f73d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:26.185454 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a080f-be42-4767-8502-18bee34f73d4 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:26.194254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 25/50] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:26.199862 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964f8e5-179e-4b0b-a2fe-c78ad9929730 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:26.311014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964f8e5-179e-4b0b-a2fe-c78ad9929730 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:26.351017 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c19c16-8569-48a2-831b-56aa28e2693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:26.351742 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c19c16-8569-48a2-831b-56aa28e2693c None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:26.352587 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c19c16-8569-48a2-831b-56aa28e2693c None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:26.352868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c19c16-8569-48a2-831b-56aa28e2693c None admin] PATH_INFO: `/v3/users/5277cece91a843118766eb0b5a214210` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:26.354195 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c19c16-8569-48a2-831b-56aa28e2693c None admin] RBAC: Authorizing `identity:get_user(user_id=5277cece91a843118766eb0b5a214210)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:26.355785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c19c16-8569-48a2-831b-56aa28e2693c None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:26.357560 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 26/51] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:26 2022] GET /identity/v3/users/5277cece91a843118766eb0b5a214210 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:26.363349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a080f-be42-4767-8502-18bee34f73d4 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:26.475845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a080f-be42-4767-8502-18bee34f73d4 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:26.490103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:26.495344 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b4927-55b1-4869-89f4-67b53ea59de9 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:26.495840 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b4927-55b1-4869-89f4-67b53ea59de9 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:26.496118 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b4927-55b1-4869-89f4-67b53ea59de9 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:26.497485 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 27/52] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:03:26.505506 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa3bc1-236f-4472-aab7-e7d6b77291f8 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:26.505870 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa3bc1-236f-4472-aab7-e7d6b77291f8 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:26.506056 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa3bc1-236f-4472-aab7-e7d6b77291f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:26.515120 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34c38e-2706-49b0-997f-528fd25b877c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:26.515815 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34c38e-2706-49b0-997f-528fd25b877c None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:26.516104 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34c38e-2706-49b0-997f-528fd25b877c None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:26.516386 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34c38e-2706-49b0-997f-528fd25b877c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:26.517532 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34c38e-2706-49b0-997f-528fd25b877c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:26.518998 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34c38e-2706-49b0-997f-528fd25b877c None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:26.520628 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 26/53] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:03:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:26.525011 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-35aa3bc1-236f-4472-aab7-e7d6b77291f8 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:26.526287 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-35aa3bc1-236f-4472-aab7-e7d6b77291f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:26.526824 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34c38e-2706-49b0-997f-528fd25b877c None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:26.551522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:26.607094 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 28/54] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:03:26.632250 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa3bc1-236f-4472-aab7-e7d6b77291f8 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:26.634185 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34c38e-2706-49b0-997f-528fd25b877c None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:26.676524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0a53b-1c53-4be6-b638-105cc19b91aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:26.677165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0a53b-1c53-4be6-b638-105cc19b91aa None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:26.677822 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0a53b-1c53-4be6-b638-105cc19b91aa None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:26.678111 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0a53b-1c53-4be6-b638-105cc19b91aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:26.678923 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0a53b-1c53-4be6-b638-105cc19b91aa None admin] RBAC: Adding query filter params (role.id=f2a8452a65264f9ea10467160b1bd735, scope.domain.id=default, user.id=5277cece91a843118766eb0b5a214210) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:26.679238 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0a53b-1c53-4be6-b638-105cc19b91aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:26.680790 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0a53b-1c53-4be6-b638-105cc19b91aa None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:26.690893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 27/55] 10.222.0.71 () {56 vars in 1322 bytes} [Thu Jul 28 11:03:26 2022] GET /identity/v3/role_assignments?user.id=5277cece91a843118766eb0b5a214210&scope.domain.id=default&role.id=f2a8452a65264f9ea10467160b1bd735 => generated 530 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:03:26.742091 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa3bc1-236f-4472-aab7-e7d6b77291f8 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:26.780818 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5a97e-225f-42ad-b30f-f20223d2d01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:26.781801 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5a97e-225f-42ad-b30f-f20223d2d01c None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:26.781801 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5a97e-225f-42ad-b30f-f20223d2d01c None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:26.782066 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5a97e-225f-42ad-b30f-f20223d2d01c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:26.783748 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5a97e-225f-42ad-b30f-f20223d2d01c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:26.786052 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5a97e-225f-42ad-b30f-f20223d2d01c None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:26.787854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 29/56] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:03:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:03:26.794533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0a53b-1c53-4be6-b638-105cc19b91aa None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:26.845427 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:26.909856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0a53b-1c53-4be6-b638-105cc19b91aa None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:26.947826 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eea7f-fe3c-4623-8a7a-ccfc90835b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:26.948475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eea7f-fe3c-4623-8a7a-ccfc90835b5b None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:26.948764 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eea7f-fe3c-4623-8a7a-ccfc90835b5b None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:26.949047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eea7f-fe3c-4623-8a7a-ccfc90835b5b None admin] PATH_INFO: `/v3/projects` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:26.949815 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20eea7f-fe3c-4623-8a7a-ccfc90835b5b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:26.951338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20eea7f-fe3c-4623-8a7a-ccfc90835b5b None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:26.978711 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 28/57] 10.222.0.71 () {60 vars in 1140 bytes} [Thu Jul 28 11:03:26 2022] POST /identity/v3/projects => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 11:03:29.278391 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68f35e-160b-484e-baa8-b222599a8b1e None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:29.278958 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68f35e-160b-484e-baa8-b222599a8b1e None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:29.278958 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68f35e-160b-484e-baa8-b222599a8b1e None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:29.280372 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 30/58] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:29.285497 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be492dbf-2911-42b8-b37e-a0b349f5c362 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:29.285926 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be492dbf-2911-42b8-b37e-a0b349f5c362 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:29.286109 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be492dbf-2911-42b8-b37e-a0b349f5c362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:29.304125 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-be492dbf-2911-42b8-b37e-a0b349f5c362 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:29.305842 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-be492dbf-2911-42b8-b37e-a0b349f5c362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:29.375711 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 29/59] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:29.402064 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68f35e-160b-484e-baa8-b222599a8b1e None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:29.430375 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:29.511908 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68f35e-160b-484e-baa8-b222599a8b1e None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:29.544497 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedca76-871f-49a0-bba3-3d13aa942c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:29.545059 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedca76-871f-49a0-bba3-3d13aa942c98 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:29.545344 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedca76-871f-49a0-bba3-3d13aa942c98 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:29.545623 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedca76-871f-49a0-bba3-3d13aa942c98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:29.546766 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fedca76-871f-49a0-bba3-3d13aa942c98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:29.548246 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fedca76-871f-49a0-bba3-3d13aa942c98 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:29.549822 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 31/60] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:03:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:29.555933 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be492dbf-2911-42b8-b37e-a0b349f5c362 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:29.582239 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:29.653064 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be492dbf-2911-42b8-b37e-a0b349f5c362 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:29.686807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4a6de-f5a7-4675-ab00-eca66f895251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:29.687463 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4a6de-f5a7-4675-ab00-eca66f895251 None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:29.687754 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4a6de-f5a7-4675-ab00-eca66f895251 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:29.688036 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4a6de-f5a7-4675-ab00-eca66f895251 None admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:29.688727 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4a6de-f5a7-4675-ab00-eca66f895251 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:29.690197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4a6de-f5a7-4675-ab00-eca66f895251 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:29.716278 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 30/61] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Jul 28 11:03:29 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:03:33.384515 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6797eee-ddcd-4b6a-9671-971fc1f719c4 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:33.385745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6797eee-ddcd-4b6a-9671-971fc1f719c4 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:33.386379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6797eee-ddcd-4b6a-9671-971fc1f719c4 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:33.387975 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 32/62] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:33.393873 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79549f-d6f5-4377-8f44-7f2d78399a0a None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:33.394334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79549f-d6f5-4377-8f44-7f2d78399a0a None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:33.394517 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79549f-d6f5-4377-8f44-7f2d78399a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:33.436166 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-4f79549f-d6f5-4377-8f44-7f2d78399a0a None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:33.437428 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-4f79549f-d6f5-4377-8f44-7f2d78399a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:33.486166 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2b846-d457-4dfd-9f5f-14ac81045ab3 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:33.486803 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2b846-d457-4dfd-9f5f-14ac81045ab3 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:33.487314 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2b846-d457-4dfd-9f5f-14ac81045ab3 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:33.488873 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 33/63] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:33.494716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5afb5e-6bec-41a7-9e86-e119ba9b1028 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:33.495372 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5afb5e-6bec-41a7-9e86-e119ba9b1028 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:33.495870 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5afb5e-6bec-41a7-9e86-e119ba9b1028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:33.515426 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-ce5afb5e-6bec-41a7-9e86-e119ba9b1028 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:33.517076 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-ce5afb5e-6bec-41a7-9e86-e119ba9b1028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:33.527029 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 31/64] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:33.535291 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a55ec6-3a72-4400-99fa-a6dcf77692e3 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:33.535291 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a55ec6-3a72-4400-99fa-a6dcf77692e3 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:33.535291 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a55ec6-3a72-4400-99fa-a6dcf77692e3 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:33.535291 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 32/65] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:33.535919 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154021da-6198-4ac5-931a-424bcfbf902f None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:33.536864 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154021da-6198-4ac5-931a-424bcfbf902f None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:33.537181 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154021da-6198-4ac5-931a-424bcfbf902f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:33.558944 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-154021da-6198-4ac5-931a-424bcfbf902f None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:33.560796 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-154021da-6198-4ac5-931a-424bcfbf902f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:33.569688 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:33.631825 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 34/66] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:03:33.633014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5afb5e-6bec-41a7-9e86-e119ba9b1028 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:33.642810 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 33/67] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:03:33.644458 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b51f09-c19b-480c-ac2e-b50927198773 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:33.644957 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b51f09-c19b-480c-ac2e-b50927198773 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:33.645432 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b51f09-c19b-480c-ac2e-b50927198773 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:33.647168 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 34/68] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:33.654402 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2e2e6-0f5c-49ec-94a0-bc3406970a98 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:33.654953 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2e2e6-0f5c-49ec-94a0-bc3406970a98 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:33.655598 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2e2e6-0f5c-49ec-94a0-bc3406970a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:33.679411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:33.680686 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-53d2e2e6-0f5c-49ec-94a0-bc3406970a98 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:33.682179 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-53d2e2e6-0f5c-49ec-94a0-bc3406970a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:33.764641 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5afb5e-6bec-41a7-9e86-e119ba9b1028 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:33.765787 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 35/69] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:33.767045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2e2e6-0f5c-49ec-94a0-bc3406970a98 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:33.808233 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a0dda-90d0-46bd-b55a-bd3cb37da529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:33.808897 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a0dda-90d0-46bd-b55a-bd3cb37da529 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:33.809185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a0dda-90d0-46bd-b55a-bd3cb37da529 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:33.809467 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a0dda-90d0-46bd-b55a-bd3cb37da529 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:33.822156 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a0dda-90d0-46bd-b55a-bd3cb37da529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:33.827229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-6f3a0dda-90d0-46bd-b55a-bd3cb37da529 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:03:33.827229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:33.827229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:33.827229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:33.827229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:33.827229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:33.827229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:33.827229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:33.827229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:33.827229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:33.827229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:33.827229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:33.827229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:33.827229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:33.827229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:33.827229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:33.828448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:33.828448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:33.828448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:33.828448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:33.828448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:33.828448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:33.828448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:33.828448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:33.828448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:33.828448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:33.828448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:33.828448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:33.828448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:33.828448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:33.828448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:33.828448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:33.829348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:33.829348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:33.829348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:33.829348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:33.829348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:33.829348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:33.829348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:33.829348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:33.829348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:33.829348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:33.829348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:03:33.829348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:03:33.829348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 35/70] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Jul 28 11:03:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:33.833833 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a0dda-90d0-46bd-b55a-bd3cb37da529 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:33.848033 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:33.886259 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2e2e6-0f5c-49ec-94a0-bc3406970a98 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:33.920330 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8aacf-23e5-4045-85c6-63854a787f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:33.920978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8aacf-23e5-4045-85c6-63854a787f5f None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:33.921266 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8aacf-23e5-4045-85c6-63854a787f5f None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:33.921542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8aacf-23e5-4045-85c6-63854a787f5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:33.924422 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:33.933307 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8aacf-23e5-4045-85c6-63854a787f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:33.938282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-55b8aacf-23e5-4045-85c6-63854a787f5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:03:33.938282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:33.938282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:33.938282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:33.938282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:33.938282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:33.938282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:33.938282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:33.938282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:33.938282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:33.938282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:33.938282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:33.938282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:33.938282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:33.938282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:33.938282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:33.939126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:33.939126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:33.939126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:33.939126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:33.939126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:33.939126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:33.939126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:33.939126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:33.939126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:33.939126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:33.939126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:33.939126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:33.939126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:33.939126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:33.939126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:33.939126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:33.939911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:33.939911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:33.939911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:33.939911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:33.939911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:33.939911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:33.939911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:33.939911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:33.939911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:33.939911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:33.939911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:03:33.939911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:03:33.939911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 36/71] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:33.940530 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8aacf-23e5-4045-85c6-63854a787f5f None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:33.943078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a0dda-90d0-46bd-b55a-bd3cb37da529 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:33.982553 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf6489-c895-4754-b77d-1e2a02f9ad09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:33.983208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf6489-c895-4754-b77d-1e2a02f9ad09 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:33.983548 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf6489-c895-4754-b77d-1e2a02f9ad09 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:33.983808 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf6489-c895-4754-b77d-1e2a02f9ad09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:33.994727 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf6489-c895-4754-b77d-1e2a02f9ad09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:33.999771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-ecaf6489-c895-4754-b77d-1e2a02f9ad09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:03:33.999771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:33.999771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:33.999771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:33.999771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:33.999771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:33.999771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:33.999771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:33.999771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:33.999771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:33.999771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:33.999771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:33.999771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:33.999771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:33.999771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:33.999771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:34.000844 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:34.000844 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:34.000844 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:34.000844 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:34.000844 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:34.000844 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:34.000844 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:34.000844 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:34.000844 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:34.000844 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:34.000844 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:34.000844 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:34.000844 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:34.000844 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:34.000844 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:34.000844 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:34.001631 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:34.001631 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:34.001631 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:34.001631 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:34.001631 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:34.001631 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:34.001631 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:34.001631 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:34.001631 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:34.001631 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:34.001631 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:03:34.001631 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:03:34.001631 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 36/72] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:03:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:34.002273 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf6489-c895-4754-b77d-1e2a02f9ad09 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:34.051915 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8aacf-23e5-4045-85c6-63854a787f5f None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:34.082621 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:34.089826 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f481d-0fab-4b9f-b1ba-1da454eabe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:34.090485 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f481d-0fab-4b9f-b1ba-1da454eabe21 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:34.090784 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f481d-0fab-4b9f-b1ba-1da454eabe21 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:34.091062 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f481d-0fab-4b9f-b1ba-1da454eabe21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:34.101524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f481d-0fab-4b9f-b1ba-1da454eabe21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:34.107134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-9e2f481d-0fab-4b9f-b1ba-1da454eabe21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:03:34.107134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:34.107134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:34.107134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:34.107134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:34.107134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:34.107134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:34.107134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:34.107134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:34.107134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:34.107134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:34.107134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:34.107134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:34.107134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:34.107134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:34.107134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:34.108107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:34.108107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:34.108107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:34.108107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:34.108107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:34.108107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:34.108107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:34.108107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:34.108107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:34.108107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:34.108107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:34.108107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:34.108107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:34.108107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:34.108107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:34.108107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:34.108844 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:34.108844 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:34.108844 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:34.108844 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:34.108844 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:34.108844 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:34.108844 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:34.108844 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:34.108844 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:34.108844 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:34.108844 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:03:34.108844 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:03:34.109414 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf6489-c895-4754-b77d-1e2a02f9ad09 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:34.111407 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 37/73] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:34.112901 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa9635-9948-483d-b3ee-218268e7bc92 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:34.113385 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa9635-9948-483d-b3ee-218268e7bc92 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:34.113672 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa9635-9948-483d-b3ee-218268e7bc92 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:34.114960 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 38/74] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:34.119129 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa9635-9948-483d-b3ee-218268e7bc92 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:34.141569 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a68314-32e3-49c9-bc34-80e750796f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:34.142121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a68314-32e3-49c9-bc34-80e750796f09 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:34.142410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a68314-32e3-49c9-bc34-80e750796f09 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:34.142694 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a68314-32e3-49c9-bc34-80e750796f09 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:34.143456 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a68314-32e3-49c9-bc34-80e750796f09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:34.143776 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a68314-32e3-49c9-bc34-80e750796f09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:34.145178 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a68314-32e3-49c9-bc34-80e750796f09 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:34.153797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 37/75] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:34.155402 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a68314-32e3-49c9-bc34-80e750796f09 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:34.167342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:34.219093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa9635-9948-483d-b3ee-218268e7bc92 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:34.254184 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667c7d8-a7d3-40c6-b3d5-bd2aab03530e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:34.254825 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667c7d8-a7d3-40c6-b3d5-bd2aab03530e None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:34.255089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667c7d8-a7d3-40c6-b3d5-bd2aab03530e None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:34.255403 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667c7d8-a7d3-40c6-b3d5-bd2aab03530e None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:34.256148 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667c7d8-a7d3-40c6-b3d5-bd2aab03530e None admin] RBAC: Adding query filter params (name=member) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:34.256479 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667c7d8-a7d3-40c6-b3d5-bd2aab03530e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:34.257413 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a68314-32e3-49c9-bc34-80e750796f09 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:34.258402 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667c7d8-a7d3-40c6-b3d5-bd2aab03530e None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:34.266736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 39/76] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:03:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:34.267559 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667c7d8-a7d3-40c6-b3d5-bd2aab03530e None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:34.296816 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e51d2-24c0-42ad-ba1b-d629c9d2f3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:34.297443 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e51d2-24c0-42ad-ba1b-d629c9d2f3b8 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:34.297728 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e51d2-24c0-42ad-ba1b-d629c9d2f3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:34.298008 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e51d2-24c0-42ad-ba1b-d629c9d2f3b8 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:34.298753 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e51d2-24c0-42ad-ba1b-d629c9d2f3b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:34.299065 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e51d2-24c0-42ad-ba1b-d629c9d2f3b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:34.300496 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e51d2-24c0-42ad-ba1b-d629c9d2f3b8 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:34.309483 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 38/77] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:03:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:34.310763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0630283-3f8f-4a02-9f10-2b8e1c733e04 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:34.311060 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0630283-3f8f-4a02-9f10-2b8e1c733e04 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:34.311368 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0630283-3f8f-4a02-9f10-2b8e1c733e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:34.324684 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:34.329816 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-a0630283-3f8f-4a02-9f10-2b8e1c733e04 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:34.331008 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-a0630283-3f8f-4a02-9f10-2b8e1c733e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:34.370338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667c7d8-a7d3-40c6-b3d5-bd2aab03530e None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:34.396684 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:34.402483 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 39/78] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:34.403577 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0630283-3f8f-4a02-9f10-2b8e1c733e04 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:34.408483 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a6a77-5a8f-4419-a813-1385f3ad2316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:34.409120 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6a77-5a8f-4419-a813-1385f3ad2316 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:34.409402 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6a77-5a8f-4419-a813-1385f3ad2316 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:34.409677 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6a77-5a8f-4419-a813-1385f3ad2316 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:34.410474 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a6a77-5a8f-4419-a813-1385f3ad2316 None admin] RBAC: Adding query filter params (name=member) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:34.410783 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a6a77-5a8f-4419-a813-1385f3ad2316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:34.412407 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a6a77-5a8f-4419-a813-1385f3ad2316 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:34.421461 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 40/79] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:03:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:34.426948 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a6a77-5a8f-4419-a813-1385f3ad2316 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:34.513484 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0630283-3f8f-4a02-9f10-2b8e1c733e04 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:34.540690 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a6a77-5a8f-4419-a813-1385f3ad2316 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:34.549002 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c9f33-b895-4cf6-9b40-1a5dc9b6a2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:34.549660 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c9f33-b895-4cf6-9b40-1a5dc9b6a2cb None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:34.549946 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c9f33-b895-4cf6-9b40-1a5dc9b6a2cb None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:34.550225 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c9f33-b895-4cf6-9b40-1a5dc9b6a2cb None admin] PATH_INFO: `/v3/users/5277cece91a843118766eb0b5a214210` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:34.551464 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c9f33-b895-4cf6-9b40-1a5dc9b6a2cb None admin] RBAC: Authorizing `identity:get_user(user_id=5277cece91a843118766eb0b5a214210)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:34.552927 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c9f33-b895-4cf6-9b40-1a5dc9b6a2cb None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:34.554731 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 40/80] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:34 2022] GET /identity/v3/users/5277cece91a843118766eb0b5a214210 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:34.555887 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c9f33-b895-4cf6-9b40-1a5dc9b6a2cb None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:34.557942 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:34.577183 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38522535-147e-44c3-ac66-709dc8bbee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:34.577845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38522535-147e-44c3-ac66-709dc8bbee49 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:34.578135 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38522535-147e-44c3-ac66-709dc8bbee49 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:34.578417 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38522535-147e-44c3-ac66-709dc8bbee49 None admin] PATH_INFO: `/v3/users/ed549f7c8f5d4711bcb4f60dff8f3746` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:34.593660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38522535-147e-44c3-ac66-709dc8bbee49 None admin] RBAC: Authorizing `identity:get_user(user_id=ed549f7c8f5d4711bcb4f60dff8f3746)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:34.595111 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38522535-147e-44c3-ac66-709dc8bbee49 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:34.596829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 41/81] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:34 2022] GET /identity/v3/users/ed549f7c8f5d4711bcb4f60dff8f3746 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:34.597602 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38522535-147e-44c3-ac66-709dc8bbee49 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:34.624156 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:34.661042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c9f33-b895-4cf6-9b40-1a5dc9b6a2cb None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:34.696393 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7456d-a839-4ac0-809c-01a88128f153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:34.697043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7456d-a839-4ac0-809c-01a88128f153 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:34.697324 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7456d-a839-4ac0-809c-01a88128f153 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:34.697602 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7456d-a839-4ac0-809c-01a88128f153 None admin] PATH_INFO: `/v3/users/ed549f7c8f5d4711bcb4f60dff8f3746` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:34.698790 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7456d-a839-4ac0-809c-01a88128f153 None admin] RBAC: Authorizing `identity:get_user(user_id=ed549f7c8f5d4711bcb4f60dff8f3746)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:34.700270 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7456d-a839-4ac0-809c-01a88128f153 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:34.702038 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 41/82] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:34 2022] GET /identity/v3/users/ed549f7c8f5d4711bcb4f60dff8f3746 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:34.702631 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7456d-a839-4ac0-809c-01a88128f153 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:34.706256 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38522535-147e-44c3-ac66-709dc8bbee49 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:34.741950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04efeb-7ec4-4278-a05b-e3e72765c9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:34.743101 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04efeb-7ec4-4278-a05b-e3e72765c9c1 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:34.743422 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04efeb-7ec4-4278-a05b-e3e72765c9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:34.743705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04efeb-7ec4-4278-a05b-e3e72765c9c1 None admin] PATH_INFO: `/v3/users/ed549f7c8f5d4711bcb4f60dff8f3746` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:34.744916 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04efeb-7ec4-4278-a05b-e3e72765c9c1 None admin] RBAC: Authorizing `identity:get_user(user_id=ed549f7c8f5d4711bcb4f60dff8f3746)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:34.746406 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04efeb-7ec4-4278-a05b-e3e72765c9c1 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:34.748071 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 42/83] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:34 2022] GET /identity/v3/users/ed549f7c8f5d4711bcb4f60dff8f3746 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:34.749373 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04efeb-7ec4-4278-a05b-e3e72765c9c1 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:34.793940 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:34.810942 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7456d-a839-4ac0-809c-01a88128f153 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:34.845009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf207f65-3229-499e-ab5b-2357f060ca42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:34.845672 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf207f65-3229-499e-ab5b-2357f060ca42 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:34.845957 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf207f65-3229-499e-ab5b-2357f060ca42 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:34.846242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf207f65-3229-499e-ab5b-2357f060ca42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:34.847434 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf207f65-3229-499e-ab5b-2357f060ca42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:34.848929 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf207f65-3229-499e-ab5b-2357f060ca42 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:34.849896 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04efeb-7ec4-4278-a05b-e3e72765c9c1 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:34.850529 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 42/84] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:03:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:34.851318 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf207f65-3229-499e-ab5b-2357f060ca42 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:34.858083 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:34.889729 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a62767-e425-477d-9820-3f79b735dfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:34.890349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a62767-e425-477d-9820-3f79b735dfd7 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:34.890637 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a62767-e425-477d-9820-3f79b735dfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:34.890915 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a62767-e425-477d-9820-3f79b735dfd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:34.960998 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf207f65-3229-499e-ab5b-2357f060ca42 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:34.962392 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a62767-e425-477d-9820-3f79b735dfd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:34.963973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a62767-e425-477d-9820-3f79b735dfd7 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:34.996826 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f3bea-05ff-421e-86df-a38a1a9de3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:34.997461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f3bea-05ff-421e-86df-a38a1a9de3e8 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:34.997745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f3bea-05ff-421e-86df-a38a1a9de3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:34.998027 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f3bea-05ff-421e-86df-a38a1a9de3e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:35.007724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:35.068974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 43/85] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:03:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:35.070141 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a62767-e425-477d-9820-3f79b735dfd7 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:35.087582 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f3bea-05ff-421e-86df-a38a1a9de3e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:35.089098 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f3bea-05ff-421e-86df-a38a1a9de3e8 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:35.092594 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:35.178968 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a62767-e425-477d-9820-3f79b735dfd7 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:35.204188 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 43/86] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:03:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:35.204188 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f3bea-05ff-421e-86df-a38a1a9de3e8 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:35.216245 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a3cee-d9a5-41e6-8088-a7e7db749980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:35.216807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a3cee-d9a5-41e6-8088-a7e7db749980 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:35.217096 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a3cee-d9a5-41e6-8088-a7e7db749980 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:35.217376 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a3cee-d9a5-41e6-8088-a7e7db749980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:35.229792 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:35.291009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a3cee-d9a5-41e6-8088-a7e7db749980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:35.292793 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a3cee-d9a5-41e6-8088-a7e7db749980 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:35.315148 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f3bea-05ff-421e-86df-a38a1a9de3e8 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:35.317796 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:35.352768 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d027e6-cb7b-480b-9018-5cc4ecc9033b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:35.353403 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d027e6-cb7b-480b-9018-5cc4ecc9033b None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:35.353693 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d027e6-cb7b-480b-9018-5cc4ecc9033b None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:35.353976 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d027e6-cb7b-480b-9018-5cc4ecc9033b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:35.402422 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 44/87] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:03:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:35.403325 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a3cee-d9a5-41e6-8088-a7e7db749980 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:35.435290 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d027e6-cb7b-480b-9018-5cc4ecc9033b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:35.436783 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d027e6-cb7b-480b-9018-5cc4ecc9033b None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:35.455292 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:35.517600 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a3cee-d9a5-41e6-8088-a7e7db749980 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:35.542904 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 44/88] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:03:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:35.548558 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d027e6-cb7b-480b-9018-5cc4ecc9033b None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:35.551864 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:35.552199 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6bab2-ca40-4796-ab9e-2058711b621d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:35.553038 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6bab2-ca40-4796-ab9e-2058711b621d None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:35.553405 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6bab2-ca40-4796-ab9e-2058711b621d None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:35.553405 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6bab2-ca40-4796-ab9e-2058711b621d None admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:35.554078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6bab2-ca40-4796-ab9e-2058711b621d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:35.556313 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6bab2-ca40-4796-ab9e-2058711b621d None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:35.580144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 45/89] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Jul 28 11:03:35 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:03:35.581049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6bab2-ca40-4796-ab9e-2058711b621d None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:35.679406 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d027e6-cb7b-480b-9018-5cc4ecc9033b None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:35.701636 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:35.707295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6bab2-ca40-4796-ab9e-2058711b621d None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:35.721130 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21db6f-3ebf-4d57-8edd-b10b39d01c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:35.721817 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21db6f-3ebf-4d57-8edd-b10b39d01c36 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:35.722115 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21db6f-3ebf-4d57-8edd-b10b39d01c36 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:35.722403 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21db6f-3ebf-4d57-8edd-b10b39d01c36 None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:35.723780 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21db6f-3ebf-4d57-8edd-b10b39d01c36 None admin] RBAC: Authorizing `identity:get_project(project_id=19ee209183e74289b7ddcfce7e067a7a)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:35.725361 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21db6f-3ebf-4d57-8edd-b10b39d01c36 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:35.732809 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 45/90] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:35 2022] GET /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:35.732809 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21db6f-3ebf-4d57-8edd-b10b39d01c36 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:35.758778 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d97a5-c989-48ef-b865-f326ff268bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:35.759503 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d97a5-c989-48ef-b865-f326ff268bca None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:35.760059 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d97a5-c989-48ef-b865-f326ff268bca None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:35.760347 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d97a5-c989-48ef-b865-f326ff268bca None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:35.761666 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d97a5-c989-48ef-b865-f326ff268bca None admin] RBAC: Authorizing `identity:get_project(project_id=19ee209183e74289b7ddcfce7e067a7a)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:35.763193 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d97a5-c989-48ef-b865-f326ff268bca None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:35.765257 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 46/91] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:35 2022] GET /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:35.765900 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d97a5-c989-48ef-b865-f326ff268bca None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:35.824570 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:35.861394 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21db6f-3ebf-4d57-8edd-b10b39d01c36 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:35.904259 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d97a5-c989-48ef-b865-f326ff268bca None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:35.913037 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df443a-1af8-4b66-b8ea-1933c39d8acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:35.913714 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df443a-1af8-4b66-b8ea-1933c39d8acf None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:35.914009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df443a-1af8-4b66-b8ea-1933c39d8acf None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:35.914349 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df443a-1af8-4b66-b8ea-1933c39d8acf None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:35.917218 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df443a-1af8-4b66-b8ea-1933c39d8acf None admin] RBAC: Authorizing `identity:get_project(project_id=19ee209183e74289b7ddcfce7e067a7a)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:35.918658 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df443a-1af8-4b66-b8ea-1933c39d8acf None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:35.920448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 46/92] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:35 2022] GET /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:35.921248 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df443a-1af8-4b66-b8ea-1933c39d8acf None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:35.948956 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb5a3f-6c6f-4254-8694-d13f4d243731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:35.949628 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb5a3f-6c6f-4254-8694-d13f4d243731 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:35.949926 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb5a3f-6c6f-4254-8694-d13f4d243731 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:35.950210 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb5a3f-6c6f-4254-8694-d13f4d243731 None admin] PATH_INFO: `/v3/projects/c5f8fd499932493c99d06f9a58854406` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:35.951457 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb5a3f-6c6f-4254-8694-d13f4d243731 None admin] RBAC: Authorizing `identity:get_project(project_id=c5f8fd499932493c99d06f9a58854406)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:35.952952 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb5a3f-6c6f-4254-8694-d13f4d243731 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:35.954709 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 47/93] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:35 2022] GET /identity/v3/projects/c5f8fd499932493c99d06f9a58854406 => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:35.955617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb5a3f-6c6f-4254-8694-d13f4d243731 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:35.999772 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:36.046262 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df443a-1af8-4b66-b8ea-1933c39d8acf None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:36.076449 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb5a3f-6c6f-4254-8694-d13f4d243731 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:36.083001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f91b91-87bb-49c7-bb44-271d563c15b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:36.083668 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f91b91-87bb-49c7-bb44-271d563c15b0 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:36.083956 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f91b91-87bb-49c7-bb44-271d563c15b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:36.084237 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f91b91-87bb-49c7-bb44-271d563c15b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:36.085038 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f91b91-87bb-49c7-bb44-271d563c15b0 None admin] RBAC: Adding query filter params (role.id=f2a8452a65264f9ea10467160b1bd735, scope.project.id=19ee209183e74289b7ddcfce7e067a7a, user.id=5277cece91a843118766eb0b5a214210) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:36.085353 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f91b91-87bb-49c7-bb44-271d563c15b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:36.087452 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f91b91-87bb-49c7-bb44-271d563c15b0 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:36.093793 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 47/94] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:03:35 2022] GET /identity/v3/role_assignments?user.id=5277cece91a843118766eb0b5a214210&scope.project.id=19ee209183e74289b7ddcfce7e067a7a&role.id=f2a8452a65264f9ea10467160b1bd735 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:36.094697 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f91b91-87bb-49c7-bb44-271d563c15b0 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:36.098682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:36.120277 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32b2dc-1da3-4f69-87a2-36186a7867df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:36.121314 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32b2dc-1da3-4f69-87a2-36186a7867df None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:36.121826 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32b2dc-1da3-4f69-87a2-36186a7867df None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:36.122347 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32b2dc-1da3-4f69-87a2-36186a7867df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:36.123545 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32b2dc-1da3-4f69-87a2-36186a7867df None admin] RBAC: Adding query filter params (role.id=05bb46007d644829b12b0d4ded0bd8d2, scope.project.id=19ee209183e74289b7ddcfce7e067a7a, user.id=ed549f7c8f5d4711bcb4f60dff8f3746) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:36.124179 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32b2dc-1da3-4f69-87a2-36186a7867df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:36.126059 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32b2dc-1da3-4f69-87a2-36186a7867df None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:36.133705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 48/95] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:03:35 2022] GET /identity/v3/role_assignments?user.id=ed549f7c8f5d4711bcb4f60dff8f3746&scope.project.id=19ee209183e74289b7ddcfce7e067a7a&role.id=05bb46007d644829b12b0d4ded0bd8d2 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:36.135163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32b2dc-1da3-4f69-87a2-36186a7867df None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:36.255978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:36.262297 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32b2dc-1da3-4f69-87a2-36186a7867df None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:36.306921 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d377e1-c741-419e-aa8c-94fecce8c39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:36.308083 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d377e1-c741-419e-aa8c-94fecce8c39c None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:36.308588 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d377e1-c741-419e-aa8c-94fecce8c39c None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:36.309071 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d377e1-c741-419e-aa8c-94fecce8c39c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:36.310080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d377e1-c741-419e-aa8c-94fecce8c39c None admin] RBAC: Adding query filter params (role.id=05bb46007d644829b12b0d4ded0bd8d2, scope.project.id=c5f8fd499932493c99d06f9a58854406, user.id=ed549f7c8f5d4711bcb4f60dff8f3746) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:36.310609 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d377e1-c741-419e-aa8c-94fecce8c39c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:36.312344 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d377e1-c741-419e-aa8c-94fecce8c39c None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:36.323869 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 49/96] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:03:36 2022] GET /identity/v3/role_assignments?user.id=ed549f7c8f5d4711bcb4f60dff8f3746&scope.project.id=c5f8fd499932493c99d06f9a58854406&role.id=05bb46007d644829b12b0d4ded0bd8d2 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:36.346157 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f91b91-87bb-49c7-bb44-271d563c15b0 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:36.411422 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c7ca2-06ab-4b61-bd9d-76396671cec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:36.412083 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c7ca2-06ab-4b61-bd9d-76396671cec0 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:36.412370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c7ca2-06ab-4b61-bd9d-76396671cec0 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:36.412652 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c7ca2-06ab-4b61-bd9d-76396671cec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:36.413500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c7ca2-06ab-4b61-bd9d-76396671cec0 None admin] RBAC: Adding query filter params (role.id=e1248e4ba8a34052820e6bd72cdd8b72, scope.project.id=19ee209183e74289b7ddcfce7e067a7a, user.id=ed549f7c8f5d4711bcb4f60dff8f3746) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:36.413826 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c7ca2-06ab-4b61-bd9d-76396671cec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:36.415960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c7ca2-06ab-4b61-bd9d-76396671cec0 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:36.423114 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 48/97] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:03:36 2022] GET /identity/v3/role_assignments?user.id=ed549f7c8f5d4711bcb4f60dff8f3746&scope.project.id=19ee209183e74289b7ddcfce7e067a7a&role.id=e1248e4ba8a34052820e6bd72cdd8b72 => generated 259 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:38.555921 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d4d46-0a14-41da-9c17-a520f26b49ac None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:38.556422 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d4d46-0a14-41da-9c17-a520f26b49ac None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:38.556532 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d4d46-0a14-41da-9c17-a520f26b49ac None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:38.558009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 50/98] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:38.563540 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c373e8b-93cf-4070-8ab3-e220df0b1b8f None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:38.564003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c373e8b-93cf-4070-8ab3-e220df0b1b8f None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:38.564084 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c373e8b-93cf-4070-8ab3-e220df0b1b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:38.583084 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-5c373e8b-93cf-4070-8ab3-e220df0b1b8f None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:38.584349 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-5c373e8b-93cf-4070-8ab3-e220df0b1b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:38.667630 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:38.673350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 49/99] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:03:38.717927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d4d46-0a14-41da-9c17-a520f26b49ac None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:38.860170 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d4d46-0a14-41da-9c17-a520f26b49ac None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:38.904047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6086a-3671-43fa-89c9-d64a93529b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:38.904712 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6086a-3671-43fa-89c9-d64a93529b82 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:38.905003 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6086a-3671-43fa-89c9-d64a93529b82 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:38.905293 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6086a-3671-43fa-89c9-d64a93529b82 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:38.922358 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6086a-3671-43fa-89c9-d64a93529b82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:38.927876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-8dc6086a-3671-43fa-89c9-d64a93529b82 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 11:03:38.927876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:38.927876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:38.927876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:38.927876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:38.927876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:38.927876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:38.927876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:38.927876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:38.927876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:38.927876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:38.927876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:38.927876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:38.927876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:38.927876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:38.927876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:38.928939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:38.928939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:38.928939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:38.928939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:38.928939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:38.928939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:38.928939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:38.928939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:38.928939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:38.928939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:38.928939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:38.928939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:38.928939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:38.928939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:38.928939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:38.928939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:38.930352 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:38.930352 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:38.930352 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:38.930352 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:38.930352 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:38.930352 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:38.930352 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:38.930352 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:38.930352 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:38.930352 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:38.930352 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 11:03:38.930352 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:03:38.930352 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 51/100] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:38.935160 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c373e8b-93cf-4070-8ab3-e220df0b1b8f None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:39.064818 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c373e8b-93cf-4070-8ab3-e220df0b1b8f None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:39.114681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c34d3-9cf7-4a59-8b9a-fa30c6a8e13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:39.115362 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c34d3-9cf7-4a59-8b9a-fa30c6a8e13b None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:39.115737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c34d3-9cf7-4a59-8b9a-fa30c6a8e13b None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:39.116023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c34d3-9cf7-4a59-8b9a-fa30c6a8e13b None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:39.116761 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c34d3-9cf7-4a59-8b9a-fa30c6a8e13b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:39.117069 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c34d3-9cf7-4a59-8b9a-fa30c6a8e13b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:39.124729 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c34d3-9cf7-4a59-8b9a-fa30c6a8e13b None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:39.135899 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 50/101] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:03:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:03:39.141491 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6086a-3671-43fa-89c9-d64a93529b82 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:39.176180 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:39.282353 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6086a-3671-43fa-89c9-d64a93529b82 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:39.340383 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a39eb-dead-4c65-88c7-52344f452914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:39.341258 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a39eb-dead-4c65-88c7-52344f452914 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:39.341673 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a39eb-dead-4c65-88c7-52344f452914 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:39.341964 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a39eb-dead-4c65-88c7-52344f452914 None admin] PATH_INFO: `/v3/users/9b922f2849d345599c0e141f7bdde9e6` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:39.372983 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a39eb-dead-4c65-88c7-52344f452914 None admin] RBAC: Authorizing `identity:get_user(user_id=9b922f2849d345599c0e141f7bdde9e6)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:39.373678 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a39eb-dead-4c65-88c7-52344f452914 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:39.377811 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 52/102] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:39 2022] GET /identity/v3/users/9b922f2849d345599c0e141f7bdde9e6 => generated 289 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:39.384570 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c34d3-9cf7-4a59-8b9a-fa30c6a8e13b None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:39.450962 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3caa3-9484-42f4-abc9-1dc0eb2bd737 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:39.451235 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3caa3-9484-42f4-abc9-1dc0eb2bd737 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:39.451484 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3caa3-9484-42f4-abc9-1dc0eb2bd737 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:39.453146 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 53/103] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:03:39.458481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9218ac-1b04-4956-8b85-9f5c3fccf883 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:39.458773 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9218ac-1b04-4956-8b85-9f5c3fccf883 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:39.459053 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9218ac-1b04-4956-8b85-9f5c3fccf883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:39.481265 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-ba9218ac-1b04-4956-8b85-9f5c3fccf883 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:39.482488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-ba9218ac-1b04-4956-8b85-9f5c3fccf883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:39.495878 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:39.557889 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 54/104] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:03:39.581745 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9218ac-1b04-4956-8b85-9f5c3fccf883 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:39.607380 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c34d3-9cf7-4a59-8b9a-fa30c6a8e13b None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:39.608867 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:39.693468 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9218ac-1b04-4956-8b85-9f5c3fccf883 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:39.710876 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875cbab-cecc-4b7d-a548-621472be8f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:39.712074 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875cbab-cecc-4b7d-a548-621472be8f2b None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:39.712523 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875cbab-cecc-4b7d-a548-621472be8f2b None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:39.712807 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875cbab-cecc-4b7d-a548-621472be8f2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:39.745390 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2d8cc-d617-4c3b-8566-30f9baf2e68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:39.746178 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2d8cc-d617-4c3b-8566-30f9baf2e68f None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:39.746466 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2d8cc-d617-4c3b-8566-30f9baf2e68f None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:39.746741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2d8cc-d617-4c3b-8566-30f9baf2e68f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:39.760425 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2d8cc-d617-4c3b-8566-30f9baf2e68f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:39.765475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-96b2d8cc-d617-4c3b-8566-30f9baf2e68f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:03:39.765475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:39.765475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:39.765475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:39.765475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:39.765475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:39.765475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:39.765475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:39.765475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:39.765475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:39.765475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:39.765475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:39.765475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:39.765475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:39.765475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:39.765475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:39.766866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:39.766866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:39.766866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:39.766866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:39.766866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:39.766866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:39.766866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:39.766866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:39.766866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:39.766866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:39.766866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:39.766866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:39.766866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:39.766866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:39.766866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:39.766866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:39.767697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:39.767697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:39.767697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:39.767697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:39.767697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:39.767697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:39.767697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:39.767697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:39.767697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:39.767697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:39.767697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:03:39.767697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:03:39.767697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 55/105] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:03:39.772488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad2de3-a4c8-4c2c-b379-970a1bf0de6b None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:39.772899 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad2de3-a4c8-4c2c-b379-970a1bf0de6b None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:39.773192 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad2de3-a4c8-4c2c-b379-970a1bf0de6b None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:39.774894 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 56/106] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:39.776633 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad2de3-a4c8-4c2c-b379-970a1bf0de6b None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:39.866042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875cbab-cecc-4b7d-a548-621472be8f2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:39.868210 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875cbab-cecc-4b7d-a548-621472be8f2b None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:39.873405 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:39.911149 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad2de3-a4c8-4c2c-b379-970a1bf0de6b None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:39.952966 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe22ef-f377-45cc-a9a1-b1214996df72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:39.953612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe22ef-f377-45cc-a9a1-b1214996df72 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:39.953905 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe22ef-f377-45cc-a9a1-b1214996df72 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:39.954190 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe22ef-f377-45cc-a9a1-b1214996df72 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:39.954927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe22ef-f377-45cc-a9a1-b1214996df72 None admin] RBAC: Adding query filter params (name=member) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:39.955240 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe22ef-f377-45cc-a9a1-b1214996df72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:39.956701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe22ef-f377-45cc-a9a1-b1214996df72 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:39.967963 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 57/107] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:03:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:39.969123 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f5600-0349-4d7a-9a4b-551c4c299ad7 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:39.969418 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f5600-0349-4d7a-9a4b-551c4c299ad7 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:39.969706 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f5600-0349-4d7a-9a4b-551c4c299ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:39.981650 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:39.993512 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-ce7f5600-0349-4d7a-9a4b-551c4c299ad7 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:39.995428 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-ce7f5600-0349-4d7a-9a4b-551c4c299ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:40.031185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 51/108] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:03:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:40.037800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970b8c9-efa4-420e-bfbe-d7281c5b7269 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:40.038149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970b8c9-efa4-420e-bfbe-d7281c5b7269 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:40.038371 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970b8c9-efa4-420e-bfbe-d7281c5b7269 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:40.040101 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 52/109] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:40.045447 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a09a62-3fa9-4faa-b59e-6daa91b0f802 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:40.045741 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a09a62-3fa9-4faa-b59e-6daa91b0f802 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:40.046031 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a09a62-3fa9-4faa-b59e-6daa91b0f802 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:40.051494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 53/110] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:40.051494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a09a62-3fa9-4faa-b59e-6daa91b0f802 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:40.077259 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 58/111] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:40.078166 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f5600-0349-4d7a-9a4b-551c4c299ad7 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:40.147422 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:40.180455 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a09a62-3fa9-4faa-b59e-6daa91b0f802 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:40.189255 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f5600-0349-4d7a-9a4b-551c4c299ad7 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:40.215418 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85707e0-e4ca-42f8-838b-928e3c6726d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:40.216078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85707e0-e4ca-42f8-838b-928e3c6726d7 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:40.216361 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85707e0-e4ca-42f8-838b-928e3c6726d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:40.216649 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85707e0-e4ca-42f8-838b-928e3c6726d7 None admin] PATH_INFO: `/v3/users/ed549f7c8f5d4711bcb4f60dff8f3746` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:40.217837 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85707e0-e4ca-42f8-838b-928e3c6726d7 None admin] RBAC: Authorizing `identity:get_user(user_id=ed549f7c8f5d4711bcb4f60dff8f3746)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:40.219385 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85707e0-e4ca-42f8-838b-928e3c6726d7 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:40.220955 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 54/112] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:40 2022] GET /identity/v3/users/ed549f7c8f5d4711bcb4f60dff8f3746 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:40.224036 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2d458-5096-41ce-bad3-2cb941e85bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:40.224807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2d458-5096-41ce-bad3-2cb941e85bca None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:40.224981 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2d458-5096-41ce-bad3-2cb941e85bca None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:40.225307 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2d458-5096-41ce-bad3-2cb941e85bca None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:40.227220 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf904827-8afb-4d7e-9cdc-16c51c7c61f1 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:40.227406 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2d458-5096-41ce-bad3-2cb941e85bca None admin] RBAC: Authorizing `identity:get_project(project_id=19ee209183e74289b7ddcfce7e067a7a)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:40.227550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf904827-8afb-4d7e-9cdc-16c51c7c61f1 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:40.227829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf904827-8afb-4d7e-9cdc-16c51c7c61f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:40.228726 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2d458-5096-41ce-bad3-2cb941e85bca None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:40.230404 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 59/113] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:40 2022] GET /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:40.231604 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258271e9-0375-4a5c-82cd-1143b8d33626 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:40.231891 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258271e9-0375-4a5c-82cd-1143b8d33626 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:40.232169 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258271e9-0375-4a5c-82cd-1143b8d33626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:40.250450 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-258271e9-0375-4a5c-82cd-1143b8d33626 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:40.251490 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-cf904827-8afb-4d7e-9cdc-16c51c7c61f1 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:40.251683 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-258271e9-0375-4a5c-82cd-1143b8d33626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:40.253529 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-cf904827-8afb-4d7e-9cdc-16c51c7c61f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:40.284409 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:40.327718 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 60/114] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:40.343469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258271e9-0375-4a5c-82cd-1143b8d33626 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:40.343544 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 55/115] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:40.343544 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860b249-b175-4695-9802-77803edd6a64 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:40.343544 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860b249-b175-4695-9802-77803edd6a64 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:40.343544 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860b249-b175-4695-9802-77803edd6a64 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:40.343544 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 56/116] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:40.343544 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860b249-b175-4695-9802-77803edd6a64 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:40.405408 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:40.450177 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258271e9-0375-4a5c-82cd-1143b8d33626 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:40.457612 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860b249-b175-4695-9802-77803edd6a64 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:40.485188 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2418a-8009-4c5a-98f5-129ddba7fa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:40.485781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2418a-8009-4c5a-98f5-129ddba7fa61 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:40.486060 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2418a-8009-4c5a-98f5-129ddba7fa61 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:40.486329 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2418a-8009-4c5a-98f5-129ddba7fa61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:40.491705 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e592d-2d54-413d-ab24-5930c2be301a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:40.492927 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e592d-2d54-413d-ab24-5930c2be301a None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:40.493212 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e592d-2d54-413d-ab24-5930c2be301a None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:40.493493 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e592d-2d54-413d-ab24-5930c2be301a None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:40.494655 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e592d-2d54-413d-ab24-5930c2be301a None admin] RBAC: Authorizing `identity:get_project(project_id=19ee209183e74289b7ddcfce7e067a7a)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:40.496129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e592d-2d54-413d-ab24-5930c2be301a None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:40.497221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2418a-8009-4c5a-98f5-129ddba7fa61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:40.497780 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 57/117] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:40 2022] GET /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:40.498542 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e592d-2d54-413d-ab24-5930c2be301a None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:40.502334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-26b2418a-8009-4c5a-98f5-129ddba7fa61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:03:40.502334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:40.502334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:40.502334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:40.502334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:40.502334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:40.502334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:40.502334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:40.502334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:40.502334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:40.502334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:40.502334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:40.502334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:40.502334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:40.502334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:40.502334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:40.503142 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:40.503142 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:40.503142 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:40.503142 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:40.503142 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:40.503142 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:40.503142 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:40.503142 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:40.503142 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:40.503142 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:40.503142 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:40.503142 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:40.503142 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:40.503142 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:40.503142 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:40.503142 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:40.503970 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:40.503970 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:40.503970 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:40.503970 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:40.503970 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:40.503970 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:40.503970 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:40.503970 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:40.503970 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:40.503970 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:40.503970 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:03:40.503970 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:03:40.503970 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 61/118] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Jul 28 11:03:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:40.505171 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714ba9a-2210-4c59-a574-599d6c12e83a None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:40.505171 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714ba9a-2210-4c59-a574-599d6c12e83a None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:40.505368 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714ba9a-2210-4c59-a574-599d6c12e83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:40.523388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-1714ba9a-2210-4c59-a574-599d6c12e83a None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:40.525121 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-1714ba9a-2210-4c59-a574-599d6c12e83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:40.529783 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:40.611299 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 62/119] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:40.611299 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714ba9a-2210-4c59-a574-599d6c12e83a None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:40.622562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e592d-2d54-413d-ab24-5930c2be301a None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:40.654212 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:40.661593 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7e2b1-1d84-474b-afbb-820b15f0fedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:40.662228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7e2b1-1d84-474b-afbb-820b15f0fedf None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:40.662516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7e2b1-1d84-474b-afbb-820b15f0fedf None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:40.662799 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7e2b1-1d84-474b-afbb-820b15f0fedf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:40.663654 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7e2b1-1d84-474b-afbb-820b15f0fedf None admin] RBAC: Adding query filter params (role.id=c29fdaefa55648b582d687cc5541fb3e, scope.project.id=19ee209183e74289b7ddcfce7e067a7a, user.id=9b922f2849d345599c0e141f7bdde9e6) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:40.663969 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7e2b1-1d84-474b-afbb-820b15f0fedf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:40.666014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7e2b1-1d84-474b-afbb-820b15f0fedf None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:40.671932 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 58/120] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:03:40 2022] GET /identity/v3/role_assignments?user.id=9b922f2849d345599c0e141f7bdde9e6&scope.project.id=19ee209183e74289b7ddcfce7e067a7a&role.id=c29fdaefa55648b582d687cc5541fb3e => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:40.672767 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7e2b1-1d84-474b-afbb-820b15f0fedf None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:40.724426 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714ba9a-2210-4c59-a574-599d6c12e83a None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:40.763095 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdea470-b8f1-43ae-93dc-93b9847e70dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:40.763715 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdea470-b8f1-43ae-93dc-93b9847e70dd None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:40.764008 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdea470-b8f1-43ae-93dc-93b9847e70dd None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:40.764292 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdea470-b8f1-43ae-93dc-93b9847e70dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:40.777064 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdea470-b8f1-43ae-93dc-93b9847e70dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:40.782703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-5bdea470-b8f1-43ae-93dc-93b9847e70dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:03:40.782703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:40.782703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:40.782703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:40.782703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:40.782703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:40.782703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:40.782703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:40.782703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:40.782703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:40.782703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:40.782703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:40.782703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:40.782703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:40.782703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:40.782703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:40.783681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:40.783681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:40.783681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:40.783681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:40.783681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:40.783681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:40.783681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:40.783681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:40.783681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:40.783681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:40.783681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:40.783681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:40.783681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:40.783681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:40.783681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:40.783681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:40.785329 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:40.785329 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:40.785329 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:40.785329 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:40.785329 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:40.785329 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:40.785329 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:40.785329 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:40.785329 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:40.785329 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:40.785329 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:03:40.785329 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:03:40.785329 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 63/121] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:40.785329 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdea470-b8f1-43ae-93dc-93b9847e70dd None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:40.798677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:40.810427 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7e2b1-1d84-474b-afbb-820b15f0fedf None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:40.853037 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7a4d4-3314-49d6-b9c8-8998fe15db88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:40.853711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7a4d4-3314-49d6-b9c8-8998fe15db88 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:40.854004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7a4d4-3314-49d6-b9c8-8998fe15db88 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:40.854291 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7a4d4-3314-49d6-b9c8-8998fe15db88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:40.855916 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7a4d4-3314-49d6-b9c8-8998fe15db88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:40.857177 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7a4d4-3314-49d6-b9c8-8998fe15db88 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:40.859879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 59/122] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:03:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:40.860399 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7a4d4-3314-49d6-b9c8-8998fe15db88 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:40.916083 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdea470-b8f1-43ae-93dc-93b9847e70dd None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:40.928373 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:40.962753 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd0d84-181c-4865-a108-94968d379860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:40.963526 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd0d84-181c-4865-a108-94968d379860 None admin] REQUEST_METHOD: `PUT` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:40.963785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd0d84-181c-4865-a108-94968d379860 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:40.964073 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd0d84-181c-4865-a108-94968d379860 None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a/users/ed549f7c8f5d4711bcb4f60dff8f3746/roles/05bb46007d644829b12b0d4ded0bd8d2` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:40.966098 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd0d84-181c-4865-a108-94968d379860 None admin] RBAC: Authorizing `identity:create_grant(project_id=19ee209183e74289b7ddcfce7e067a7a, user_id=ed549f7c8f5d4711bcb4f60dff8f3746, role_id=05bb46007d644829b12b0d4ded0bd8d2)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:40.967661 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd0d84-181c-4865-a108-94968d379860 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:40.983400 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 64/123] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Jul 28 11:03:40 2022] PUT /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a/users/ed549f7c8f5d4711bcb4f60dff8f3746/roles/05bb46007d644829b12b0d4ded0bd8d2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:03:40.991607 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7a4d4-3314-49d6-b9c8-8998fe15db88 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:40.992979 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd0d84-181c-4865-a108-94968d379860 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:41.036492 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a09d0-7104-4bdf-a463-ba63261f14a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:41.037153 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a09d0-7104-4bdf-a463-ba63261f14a2 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:41.037550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a09d0-7104-4bdf-a463-ba63261f14a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:41.037835 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a09d0-7104-4bdf-a463-ba63261f14a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:41.038834 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a09d0-7104-4bdf-a463-ba63261f14a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:41.039179 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a09d0-7104-4bdf-a463-ba63261f14a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:41.040796 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a09d0-7104-4bdf-a463-ba63261f14a2 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:41.052387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 60/124] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:41.053420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a09d0-7104-4bdf-a463-ba63261f14a2 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:41.094463 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:41.168448 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd0d84-181c-4865-a108-94968d379860 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:41.209836 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce745bc8-24a7-46d8-a7a3-4219bd19c5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:41.210556 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce745bc8-24a7-46d8-a7a3-4219bd19c5d2 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:41.210852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce745bc8-24a7-46d8-a7a3-4219bd19c5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:41.211818 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce745bc8-24a7-46d8-a7a3-4219bd19c5d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:41.217520 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a09d0-7104-4bdf-a463-ba63261f14a2 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:41.223471 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce745bc8-24a7-46d8-a7a3-4219bd19c5d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:41.229124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-ce745bc8-24a7-46d8-a7a3-4219bd19c5d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:03:41.229124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:41.229124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:41.229124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:41.229124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:41.229124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:41.229124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:41.229124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:41.229124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:41.229124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:41.229124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:41.229124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:41.229124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:41.229124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:41.229124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:41.229124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:41.230045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:41.230045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:41.230045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:41.230045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:41.230045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:41.230045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:41.230045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:41.230045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:41.230045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:41.230045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:41.230045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:41.230045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:41.230045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:41.230045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:41.230045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:41.230045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:41.230801 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:41.230801 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:41.230801 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:41.230801 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:41.230801 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:41.230801 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:41.230801 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:41.230801 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:41.230801 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:41.230801 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:41.230801 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:03:41.230801 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:03:41.230801 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 65/125] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:03:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:41.231453 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce745bc8-24a7-46d8-a7a3-4219bd19c5d2 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:41.268788 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15068424-14b8-49e8-9bd5-e3511bc74db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:41.269898 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:41.271226 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15068424-14b8-49e8-9bd5-e3511bc74db9 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:41.271915 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15068424-14b8-49e8-9bd5-e3511bc74db9 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:41.272472 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15068424-14b8-49e8-9bd5-e3511bc74db9 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:41.273358 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15068424-14b8-49e8-9bd5-e3511bc74db9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:41.274408 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15068424-14b8-49e8-9bd5-e3511bc74db9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:41.276952 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15068424-14b8-49e8-9bd5-e3511bc74db9 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:41.289480 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 61/126] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:03:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:41.290589 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15068424-14b8-49e8-9bd5-e3511bc74db9 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:41.362444 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce745bc8-24a7-46d8-a7a3-4219bd19c5d2 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:41.407093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449861c-e490-4134-b818-df92818e90f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:41.407925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449861c-e490-4134-b818-df92818e90f1 None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:41.408312 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449861c-e490-4134-b818-df92818e90f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:41.408695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449861c-e490-4134-b818-df92818e90f1 None admin] PATH_INFO: `/v3/projects` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:41.409511 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449861c-e490-4134-b818-df92818e90f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:41.411252 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:41.412639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449861c-e490-4134-b818-df92818e90f1 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:41.431471 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15068424-14b8-49e8-9bd5-e3511bc74db9 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:41.454179 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 66/127] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Jul 28 11:03:41 2022] POST /identity/v3/projects => generated 302 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:03:41.455620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449861c-e490-4134-b818-df92818e90f1 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:41.472269 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391431d-77d5-475d-92c2-fff499ec9a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:41.472976 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391431d-77d5-475d-92c2-fff499ec9a9e None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:41.473309 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391431d-77d5-475d-92c2-fff499ec9a9e None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:41.473595 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391431d-77d5-475d-92c2-fff499ec9a9e None admin] PATH_INFO: `/v3/users/5277cece91a843118766eb0b5a214210` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:41.474893 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391431d-77d5-475d-92c2-fff499ec9a9e None admin] RBAC: Authorizing `identity:get_user(user_id=5277cece91a843118766eb0b5a214210)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:41.476618 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391431d-77d5-475d-92c2-fff499ec9a9e None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:41.478620 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 62/128] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:41 2022] GET /identity/v3/users/5277cece91a843118766eb0b5a214210 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:41.479224 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391431d-77d5-475d-92c2-fff499ec9a9e None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:41.608195 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:41.637102 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449861c-e490-4134-b818-df92818e90f1 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:41.643040 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391431d-77d5-475d-92c2-fff499ec9a9e None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:41.707559 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2b978-4889-441f-8ff6-92a928bc36db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:41.708318 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2b978-4889-441f-8ff6-92a928bc36db None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:41.708637 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2b978-4889-441f-8ff6-92a928bc36db None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:41.708896 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2b978-4889-441f-8ff6-92a928bc36db None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:41.709748 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2b978-4889-441f-8ff6-92a928bc36db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:41.709850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f73746-3507-473b-ab9f-f3d448cbacd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:41.710053 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2b978-4889-441f-8ff6-92a928bc36db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:41.710493 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f73746-3507-473b-ab9f-f3d448cbacd7 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:41.710777 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f73746-3507-473b-ab9f-f3d448cbacd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:41.711673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f73746-3507-473b-ab9f-f3d448cbacd7 None admin] PATH_INFO: `/v3/users/ed549f7c8f5d4711bcb4f60dff8f3746` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:41.712165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2b978-4889-441f-8ff6-92a928bc36db None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:41.712932 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f73746-3507-473b-ab9f-f3d448cbacd7 None admin] RBAC: Authorizing `identity:get_user(user_id=ed549f7c8f5d4711bcb4f60dff8f3746)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:41.714555 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f73746-3507-473b-ab9f-f3d448cbacd7 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:41.716416 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 63/129] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:41 2022] GET /identity/v3/users/ed549f7c8f5d4711bcb4f60dff8f3746 => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:41.717260 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f73746-3507-473b-ab9f-f3d448cbacd7 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:41.721675 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 67/130] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:03:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:41.722529 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2b978-4889-441f-8ff6-92a928bc36db None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:41.738987 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:41.849004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f73746-3507-473b-ab9f-f3d448cbacd7 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:41.852167 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2b978-4889-441f-8ff6-92a928bc36db None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:41.894676 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334a9f2-c8af-44b5-9226-90568cb8501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:41.895566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334a9f2-c8af-44b5-9226-90568cb8501e None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:41.895868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334a9f2-c8af-44b5-9226-90568cb8501e None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:41.896289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334a9f2-c8af-44b5-9226-90568cb8501e None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:41.898161 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334a9f2-c8af-44b5-9226-90568cb8501e None admin] RBAC: Authorizing `identity:get_project(project_id=19ee209183e74289b7ddcfce7e067a7a)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:41.899380 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed4b89-c267-4951-af6e-7cb08b5cb182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:41.900064 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed4b89-c267-4951-af6e-7cb08b5cb182 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:41.900354 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed4b89-c267-4951-af6e-7cb08b5cb182 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:41.900453 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334a9f2-c8af-44b5-9226-90568cb8501e None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:41.900636 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed4b89-c267-4951-af6e-7cb08b5cb182 None admin] PATH_INFO: `/v3/projects/c5f8fd499932493c99d06f9a58854406` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:41.901918 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed4b89-c267-4951-af6e-7cb08b5cb182 None admin] RBAC: Authorizing `identity:get_project(project_id=c5f8fd499932493c99d06f9a58854406)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:41.902711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 64/131] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:41 2022] GET /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:41.903608 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334a9f2-c8af-44b5-9226-90568cb8501e None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:41.903774 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed4b89-c267-4951-af6e-7cb08b5cb182 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:41.905525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 68/132] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:41 2022] GET /identity/v3/projects/c5f8fd499932493c99d06f9a58854406 => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:41.913114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed4b89-c267-4951-af6e-7cb08b5cb182 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:41.937648 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:42.066083 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:42.079786 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334a9f2-c8af-44b5-9226-90568cb8501e None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:42.117134 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcecb3b-d639-44ef-8e86-f08818be9bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:42.118462 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcecb3b-d639-44ef-8e86-f08818be9bc3 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:42.118751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcecb3b-d639-44ef-8e86-f08818be9bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:42.119037 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcecb3b-d639-44ef-8e86-f08818be9bc3 None admin] PATH_INFO: `/v3/users/ed549f7c8f5d4711bcb4f60dff8f3746` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:42.120313 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcecb3b-d639-44ef-8e86-f08818be9bc3 None admin] RBAC: Authorizing `identity:get_user(user_id=ed549f7c8f5d4711bcb4f60dff8f3746)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:42.121785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcecb3b-d639-44ef-8e86-f08818be9bc3 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:42.123475 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 65/133] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:41 2022] GET /identity/v3/users/ed549f7c8f5d4711bcb4f60dff8f3746 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:42.124418 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcecb3b-d639-44ef-8e86-f08818be9bc3 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:42.159094 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed4b89-c267-4951-af6e-7cb08b5cb182 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:42.234697 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcecb3b-d639-44ef-8e86-f08818be9bc3 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:42.271698 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429ad20-b8d8-421e-a16b-72343a3d894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:42.272377 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429ad20-b8d8-421e-a16b-72343a3d894f None admin] REQUEST_METHOD: `PUT` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:42.272665 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429ad20-b8d8-421e-a16b-72343a3d894f None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:42.272948 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429ad20-b8d8-421e-a16b-72343a3d894f None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a/users/5277cece91a843118766eb0b5a214210/roles/f2a8452a65264f9ea10467160b1bd735` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:42.274984 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429ad20-b8d8-421e-a16b-72343a3d894f None admin] RBAC: Authorizing `identity:create_grant(project_id=19ee209183e74289b7ddcfce7e067a7a, user_id=5277cece91a843118766eb0b5a214210, role_id=f2a8452a65264f9ea10467160b1bd735)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:42.276549 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429ad20-b8d8-421e-a16b-72343a3d894f None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:42.286617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918e1fb-7602-41f1-8908-b37350d1c1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:42.287366 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918e1fb-7602-41f1-8908-b37350d1c1dc None admin] REQUEST_METHOD: `PUT` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:42.287909 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918e1fb-7602-41f1-8908-b37350d1c1dc None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:42.288197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918e1fb-7602-41f1-8908-b37350d1c1dc None admin] PATH_INFO: `/v3/projects/c5f8fd499932493c99d06f9a58854406/users/ed549f7c8f5d4711bcb4f60dff8f3746/roles/05bb46007d644829b12b0d4ded0bd8d2` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:42.293291 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 66/134] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Jul 28 11:03:42 2022] PUT /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a/users/5277cece91a843118766eb0b5a214210/roles/f2a8452a65264f9ea10467160b1bd735 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:03:42.294321 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918e1fb-7602-41f1-8908-b37350d1c1dc None admin] RBAC: Authorizing `identity:create_grant(project_id=c5f8fd499932493c99d06f9a58854406, user_id=ed549f7c8f5d4711bcb4f60dff8f3746, role_id=05bb46007d644829b12b0d4ded0bd8d2)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:42.294558 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429ad20-b8d8-421e-a16b-72343a3d894f None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:42.296090 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918e1fb-7602-41f1-8908-b37350d1c1dc None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:42.319521 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:42.326163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 69/135] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Jul 28 11:03:41 2022] PUT /identity/v3/projects/c5f8fd499932493c99d06f9a58854406/users/ed549f7c8f5d4711bcb4f60dff8f3746/roles/05bb46007d644829b12b0d4ded0bd8d2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:03:42.497341 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429ad20-b8d8-421e-a16b-72343a3d894f None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:42.589145 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f63ac-0883-486f-bc91-ec11577e8acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:42.590792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f63ac-0883-486f-bc91-ec11577e8acb None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:42.591610 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f63ac-0883-486f-bc91-ec11577e8acb None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:42.592434 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f63ac-0883-486f-bc91-ec11577e8acb None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:42.596824 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f63ac-0883-486f-bc91-ec11577e8acb None admin] RBAC: Authorizing `identity:get_project(project_id=19ee209183e74289b7ddcfce7e067a7a)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:42.600002 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f63ac-0883-486f-bc91-ec11577e8acb None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:42.604079 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 67/136] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:42 2022] GET /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:42.612424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918e1fb-7602-41f1-8908-b37350d1c1dc None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:42.728469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:42.766786 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918e1fb-7602-41f1-8908-b37350d1c1dc None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:42.812737 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12a73d-4e85-4582-8c61-6f0f0da8808a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:42.813487 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12a73d-4e85-4582-8c61-6f0f0da8808a None admin] REQUEST_METHOD: `PUT` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:42.813923 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12a73d-4e85-4582-8c61-6f0f0da8808a None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:42.814334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12a73d-4e85-4582-8c61-6f0f0da8808a None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a/users/ed549f7c8f5d4711bcb4f60dff8f3746/roles/e1248e4ba8a34052820e6bd72cdd8b72` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:42.818424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12a73d-4e85-4582-8c61-6f0f0da8808a None admin] RBAC: Authorizing `identity:create_grant(project_id=19ee209183e74289b7ddcfce7e067a7a, user_id=ed549f7c8f5d4711bcb4f60dff8f3746, role_id=e1248e4ba8a34052820e6bd72cdd8b72)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:42.819979 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12a73d-4e85-4582-8c61-6f0f0da8808a None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:42.835829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 70/137] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Jul 28 11:03:42 2022] PUT /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a/users/ed549f7c8f5d4711bcb4f60dff8f3746/roles/e1248e4ba8a34052820e6bd72cdd8b72 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:03:43.387852 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfac302-48a7-4d5d-a368-a472df12910b None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:43.388354 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfac302-48a7-4d5d-a368-a472df12910b None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:43.388428 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfac302-48a7-4d5d-a368-a472df12910b None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:43.389911 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 68/138] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:43.404388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59f374-66f6-42c3-9e1b-351801607562 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:43.405012 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59f374-66f6-42c3-9e1b-351801607562 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:43.405525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59f374-66f6-42c3-9e1b-351801607562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:43.429565 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-fd59f374-66f6-42c3-9e1b-351801607562 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:43.431222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-fd59f374-66f6-42c3-9e1b-351801607562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:43.508968 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 71/139] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:43.541108 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfac302-48a7-4d5d-a368-a472df12910b None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:43.670407 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:43.700170 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfac302-48a7-4d5d-a368-a472df12910b None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:43.752066 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8da422-d96d-4824-8599-b5adb644910e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:43.752738 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da422-d96d-4824-8599-b5adb644910e None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:43.753023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da422-d96d-4824-8599-b5adb644910e None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:43.753306 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da422-d96d-4824-8599-b5adb644910e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:43.780687 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8da422-d96d-4824-8599-b5adb644910e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:43.791322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-ae8da422-d96d-4824-8599-b5adb644910e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 11:03:43.791322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:43.791322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:43.791322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:43.791322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:43.791322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:43.791322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:43.791322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:43.791322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:43.791322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:43.791322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:43.791322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:43.791322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:43.791322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:43.791322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:43.791322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:43.792211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:43.792211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:43.792211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:43.792211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:43.792211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:43.792211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:43.792211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:43.792211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:43.792211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:43.792211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:43.792211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:43.792211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:43.792211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:43.792211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:43.792211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:43.792211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:43.792982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:43.792982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:43.792982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:43.792982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:43.792982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:43.792982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:43.792982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:43.792982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:43.792982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:43.792982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:43.792982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 11:03:43.792982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:03:43.792982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 69/140] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:43.801078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59f374-66f6-42c3-9e1b-351801607562 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:43.891321 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17afda-412a-4089-9b67-00ee947a1ba4 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:43.891637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17afda-412a-4089-9b67-00ee947a1ba4 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:43.891880 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17afda-412a-4089-9b67-00ee947a1ba4 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:43.893513 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 70/141] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:43.899497 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8271b-edf3-4e2f-9396-6491306b0ede None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:43.899833 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8271b-edf3-4e2f-9396-6491306b0ede None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:43.900119 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8271b-edf3-4e2f-9396-6491306b0ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:43.914718 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:43.933022 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-31a8271b-edf3-4e2f-9396-6491306b0ede None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:43.934157 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-31a8271b-edf3-4e2f-9396-6491306b0ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:43.994044 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59f374-66f6-42c3-9e1b-351801607562 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:44.080970 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd64ed-6c67-44f8-a353-d12f2b79dac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:44.081621 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd64ed-6c67-44f8-a353-d12f2b79dac4 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:44.081910 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd64ed-6c67-44f8-a353-d12f2b79dac4 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:44.082193 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd64ed-6c67-44f8-a353-d12f2b79dac4 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:44.083011 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd64ed-6c67-44f8-a353-d12f2b79dac4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:44.083366 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd64ed-6c67-44f8-a353-d12f2b79dac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:44.084783 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd64ed-6c67-44f8-a353-d12f2b79dac4 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:44.097014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 71/142] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:44.102330 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 72/143] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:03:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:44.107624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8271b-edf3-4e2f-9396-6491306b0ede None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:44.146006 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd64ed-6c67-44f8-a353-d12f2b79dac4 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:44.247783 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:44.279614 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8271b-edf3-4e2f-9396-6491306b0ede None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:44.319105 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd64ed-6c67-44f8-a353-d12f2b79dac4 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:44.355771 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:44.361431 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd1190-0250-410d-9dae-4aec878ee5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:44.362106 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd1190-0250-410d-9dae-4aec878ee5fe None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:44.362389 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd1190-0250-410d-9dae-4aec878ee5fe None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:44.362673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd1190-0250-410d-9dae-4aec878ee5fe None admin] PATH_INFO: `/v3/users/9b922f2849d345599c0e141f7bdde9e6` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:44.364118 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd1190-0250-410d-9dae-4aec878ee5fe None admin] RBAC: Authorizing `identity:get_user(user_id=9b922f2849d345599c0e141f7bdde9e6)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:44.364350 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb2f50-cf68-493f-89ef-4d4ef55840cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:44.365014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb2f50-cf68-493f-89ef-4d4ef55840cf None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:44.365298 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb2f50-cf68-493f-89ef-4d4ef55840cf None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:44.365579 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb2f50-cf68-493f-89ef-4d4ef55840cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:44.365666 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd1190-0250-410d-9dae-4aec878ee5fe None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:44.367359 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 72/144] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:44 2022] GET /identity/v3/users/9b922f2849d345599c0e141f7bdde9e6 => generated 289 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:44.377217 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd1190-0250-410d-9dae-4aec878ee5fe None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:44.378322 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb2f50-cf68-493f-89ef-4d4ef55840cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:44.383976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-4bbb2f50-cf68-493f-89ef-4d4ef55840cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:03:44.383976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:44.383976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:44.383976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:44.383976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:44.383976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:44.383976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:44.383976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:44.383976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:44.383976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:44.383976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:44.383976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:44.383976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:44.383976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:44.383976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:44.383976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:44.384845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:44.384845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:44.384845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:44.384845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:44.384845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:44.384845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:44.384845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:44.384845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:44.384845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:44.384845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:44.384845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:44.384845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:44.384845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:44.384845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:44.384845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:44.384845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:44.385851 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:44.385851 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:44.385851 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:44.385851 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:44.385851 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:44.385851 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:44.385851 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:44.385851 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:44.385851 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:44.385851 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:44.385851 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:03:44.385851 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:03:44.385851 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 73/145] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:44.392352 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb2f50-cf68-493f-89ef-4d4ef55840cf None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:44.560394 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd1190-0250-410d-9dae-4aec878ee5fe None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:44.576852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb2f50-cf68-493f-89ef-4d4ef55840cf None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:44.614705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360a27b-d2d4-4b49-b5d5-81a8afbb4e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:44.615448 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360a27b-d2d4-4b49-b5d5-81a8afbb4e40 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:44.615737 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360a27b-d2d4-4b49-b5d5-81a8afbb4e40 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:44.616016 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360a27b-d2d4-4b49-b5d5-81a8afbb4e40 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:44.616814 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360a27b-d2d4-4b49-b5d5-81a8afbb4e40 None admin] RBAC: Adding query filter params (name=member) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:44.617130 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360a27b-d2d4-4b49-b5d5-81a8afbb4e40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:44.619118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360a27b-d2d4-4b49-b5d5-81a8afbb4e40 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:44.629265 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 74/146] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:03:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:03:44.629470 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30db6f-c9c1-464e-85db-f88aa293b6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:44.630285 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30db6f-c9c1-464e-85db-f88aa293b6bb None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:44.630593 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30db6f-c9c1-464e-85db-f88aa293b6bb None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:44.630964 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30db6f-c9c1-464e-85db-f88aa293b6bb None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:44.632534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30db6f-c9c1-464e-85db-f88aa293b6bb None admin] RBAC: Authorizing `identity:get_project(project_id=19ee209183e74289b7ddcfce7e067a7a)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:44.634509 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30db6f-c9c1-464e-85db-f88aa293b6bb None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:44.635155 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360a27b-d2d4-4b49-b5d5-81a8afbb4e40 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:44.636784 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 73/147] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:44 2022] GET /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:44.649944 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30db6f-c9c1-464e-85db-f88aa293b6bb None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:44.680694 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:44.728101 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:44.848374 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360a27b-d2d4-4b49-b5d5-81a8afbb4e40 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:44.903518 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30db6f-c9c1-464e-85db-f88aa293b6bb None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:44.913862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cada6-39f9-4ef0-a705-43845f8072ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:44.915058 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cada6-39f9-4ef0-a705-43845f8072ef None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:44.915368 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cada6-39f9-4ef0-a705-43845f8072ef None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:44.915646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cada6-39f9-4ef0-a705-43845f8072ef None admin] PATH_INFO: `/v3/users/ed549f7c8f5d4711bcb4f60dff8f3746` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:44.918462 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cada6-39f9-4ef0-a705-43845f8072ef None admin] RBAC: Authorizing `identity:get_user(user_id=ed549f7c8f5d4711bcb4f60dff8f3746)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:44.919983 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cada6-39f9-4ef0-a705-43845f8072ef None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:44.921645 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 75/148] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:44 2022] GET /identity/v3/users/ed549f7c8f5d4711bcb4f60dff8f3746 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:44.928400 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cada6-39f9-4ef0-a705-43845f8072ef None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:44.970159 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8f1a5-815b-41c8-aa44-4f8f1662a588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:44.970849 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8f1a5-815b-41c8-aa44-4f8f1662a588 None admin] REQUEST_METHOD: `PUT` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:44.971133 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8f1a5-815b-41c8-aa44-4f8f1662a588 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:44.971434 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8f1a5-815b-41c8-aa44-4f8f1662a588 None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a/users/9b922f2849d345599c0e141f7bdde9e6/roles/c29fdaefa55648b582d687cc5541fb3e` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:44.974165 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8f1a5-815b-41c8-aa44-4f8f1662a588 None admin] RBAC: Authorizing `identity:create_grant(project_id=19ee209183e74289b7ddcfce7e067a7a, user_id=9b922f2849d345599c0e141f7bdde9e6, role_id=c29fdaefa55648b582d687cc5541fb3e)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:44.975644 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8f1a5-815b-41c8-aa44-4f8f1662a588 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:44.997955 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 74/149] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Jul 28 11:03:44 2022] PUT /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a/users/9b922f2849d345599c0e141f7bdde9e6/roles/c29fdaefa55648b582d687cc5541fb3e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:03:45.104351 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cada6-39f9-4ef0-a705-43845f8072ef None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:45.135306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:45.137399 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c1e79-42bc-445b-99d8-4f23146a0296 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:45.137927 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c1e79-42bc-445b-99d8-4f23146a0296 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:45.138549 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c1e79-42bc-445b-99d8-4f23146a0296 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:45.140549 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 75/150] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:03:45.153495 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07fd76-2dab-46b0-a9b8-f28f13cf71e1 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:45.153794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07fd76-2dab-46b0-a9b8-f28f13cf71e1 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:45.154042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07fd76-2dab-46b0-a9b8-f28f13cf71e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:45.182153 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-af07fd76-2dab-46b0-a9b8-f28f13cf71e1 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:45.183034 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3e077-fc62-4131-9b2c-1be666fd45b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:45.183472 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-af07fd76-2dab-46b0-a9b8-f28f13cf71e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:45.183734 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3e077-fc62-4131-9b2c-1be666fd45b1 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:45.184017 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3e077-fc62-4131-9b2c-1be666fd45b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:45.184291 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3e077-fc62-4131-9b2c-1be666fd45b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:45.329431 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:45.339017 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 76/151] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:03:45.355732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3e077-fc62-4131-9b2c-1be666fd45b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:45.360947 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3e077-fc62-4131-9b2c-1be666fd45b1 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:45.385407 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07fd76-2dab-46b0-a9b8-f28f13cf71e1 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:45.549422 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 76/152] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:03:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 11:03:45.557326 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3e077-fc62-4131-9b2c-1be666fd45b1 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:45.568378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07fd76-2dab-46b0-a9b8-f28f13cf71e1 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:45.592151 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:45.650495 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931557a-ce14-4b57-bdaa-618c4adf190b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:45.651547 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931557a-ce14-4b57-bdaa-618c4adf190b None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:45.652044 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931557a-ce14-4b57-bdaa-618c4adf190b None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:45.652529 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931557a-ce14-4b57-bdaa-618c4adf190b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:45.656364 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931557a-ce14-4b57-bdaa-618c4adf190b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:45.658176 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931557a-ce14-4b57-bdaa-618c4adf190b None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:45.660163 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 77/153] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:03:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:03:45.666318 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931557a-ce14-4b57-bdaa-618c4adf190b None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:45.789476 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:45.806905 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3e077-fc62-4131-9b2c-1be666fd45b1 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:45.860048 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931557a-ce14-4b57-bdaa-618c4adf190b None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:45.892369 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421d1dc-7da7-4b1f-a96b-f6c9ef1d102f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:45.893611 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421d1dc-7da7-4b1f-a96b-f6c9ef1d102f None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:45.894059 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421d1dc-7da7-4b1f-a96b-f6c9ef1d102f None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:45.894484 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421d1dc-7da7-4b1f-a96b-f6c9ef1d102f None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:45.895882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421d1dc-7da7-4b1f-a96b-f6c9ef1d102f None admin] RBAC: Authorizing `identity:get_project(project_id=19ee209183e74289b7ddcfce7e067a7a)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:45.903361 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421d1dc-7da7-4b1f-a96b-f6c9ef1d102f None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:45.906277 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 77/154] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:45 2022] GET /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a => generated 298 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:45.915339 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421d1dc-7da7-4b1f-a96b-f6c9ef1d102f None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:45.935300 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216d1ae-6703-4830-b8b6-b9ea33aa7767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:45.935300 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216d1ae-6703-4830-b8b6-b9ea33aa7767 None admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:45.935300 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216d1ae-6703-4830-b8b6-b9ea33aa7767 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:45.935300 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216d1ae-6703-4830-b8b6-b9ea33aa7767 None admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:45.935688 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216d1ae-6703-4830-b8b6-b9ea33aa7767 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:45.935688 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216d1ae-6703-4830-b8b6-b9ea33aa7767 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:46.000353 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 78/155] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Jul 28 11:03:45 2022] POST /identity/v3/users => generated 283 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 11:03:46.002305 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e83d54-0370-4eb5-beb2-ad0c5b3997a2 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:46.002576 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e83d54-0370-4eb5-beb2-ad0c5b3997a2 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:46.002861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e83d54-0370-4eb5-beb2-ad0c5b3997a2 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:46.008692 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 79/156] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:46.033342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac4103-e6f9-4b50-97e6-6e9b9bc54f3f None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:46.033773 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac4103-e6f9-4b50-97e6-6e9b9bc54f3f None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:46.034125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac4103-e6f9-4b50-97e6-6e9b9bc54f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:46.066290 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-5cac4103-e6f9-4b50-97e6-6e9b9bc54f3f None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:46.067706 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-5cac4103-e6f9-4b50-97e6-6e9b9bc54f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:46.121893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:46.167916 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421d1dc-7da7-4b1f-a96b-f6c9ef1d102f None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:46.225386 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 80/157] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:03:46.227304 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74557933-7e49-49d1-8170-3299fcaee34c None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:46.227601 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74557933-7e49-49d1-8170-3299fcaee34c None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:46.227883 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74557933-7e49-49d1-8170-3299fcaee34c None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:46.230104 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 81/158] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:46.235753 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472f669-f54e-4aee-9c0d-fbfa0f52846b None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:46.236048 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472f669-f54e-4aee-9c0d-fbfa0f52846b None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:46.236857 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472f669-f54e-4aee-9c0d-fbfa0f52846b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:46.256092 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667314cc-920a-4aab-a6e9-108e988dd42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:46.256704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667314cc-920a-4aab-a6e9-108e988dd42c None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:46.256993 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667314cc-920a-4aab-a6e9-108e988dd42c None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:46.257105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-a472f669-f54e-4aee-9c0d-fbfa0f52846b None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:46.257260 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667314cc-920a-4aab-a6e9-108e988dd42c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:46.258618 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667314cc-920a-4aab-a6e9-108e988dd42c None admin] RBAC: Adding query filter params (role.id=05bb46007d644829b12b0d4ded0bd8d2, scope.project.id=19ee209183e74289b7ddcfce7e067a7a, user.id=ed549f7c8f5d4711bcb4f60dff8f3746) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:46.258877 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-a472f669-f54e-4aee-9c0d-fbfa0f52846b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:46.258978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667314cc-920a-4aab-a6e9-108e988dd42c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:46.260681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667314cc-920a-4aab-a6e9-108e988dd42c None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:46.271082 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 78/159] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:03:45 2022] GET /identity/v3/role_assignments?user.id=ed549f7c8f5d4711bcb4f60dff8f3746&scope.project.id=19ee209183e74289b7ddcfce7e067a7a&role.id=05bb46007d644829b12b0d4ded0bd8d2 => generated 608 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:46.271792 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667314cc-920a-4aab-a6e9-108e988dd42c None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:46.359157 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:46.407624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 82/160] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:46.436535 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667314cc-920a-4aab-a6e9-108e988dd42c None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:46.454625 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472f669-f54e-4aee-9c0d-fbfa0f52846b None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:46.493910 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a814ad3-7a73-4b32-ae7f-c34721079555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:46.494596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a814ad3-7a73-4b32-ae7f-c34721079555 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:46.494881 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a814ad3-7a73-4b32-ae7f-c34721079555 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:46.495158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a814ad3-7a73-4b32-ae7f-c34721079555 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:46.527289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a814ad3-7a73-4b32-ae7f-c34721079555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:46.536041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-2a814ad3-7a73-4b32-ae7f-c34721079555 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:03:46.536041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:46.536041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:46.536041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:46.536041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:46.536041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:46.536041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:46.536041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:46.536041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:46.536041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:46.536041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:46.536041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:46.536041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:46.536041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:46.536041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:46.536041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:46.536978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:46.536978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:46.536978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:46.536978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:46.536978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:46.536978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:46.536978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:46.536978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:46.536978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:46.536978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:46.536978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:46.536978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:46.536978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:46.536978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:46.536978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:46.536978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:46.537722 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:46.537722 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:46.537722 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:46.537722 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:46.537722 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:46.537722 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:46.537722 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:46.537722 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:46.537722 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:46.537722 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:46.537722 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:03:46.537722 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:03:46.537722 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 79/161] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:46.547328 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a814ad3-7a73-4b32-ae7f-c34721079555 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:46.569317 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:46.671727 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472f669-f54e-4aee-9c0d-fbfa0f52846b None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:46.688099 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a814ad3-7a73-4b32-ae7f-c34721079555 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:46.723550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eecc35-22dd-4615-8df1-2b5a7a25080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:46.724490 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eecc35-22dd-4615-8df1-2b5a7a25080a None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:46.724944 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eecc35-22dd-4615-8df1-2b5a7a25080a None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:46.725363 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eecc35-22dd-4615-8df1-2b5a7a25080a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:46.737316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21870a4-8329-4b63-afdd-de436ab54e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:46.737958 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21870a4-8329-4b63-afdd-de436ab54e60 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:46.738125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eecc35-22dd-4615-8df1-2b5a7a25080a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:46.738234 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21870a4-8329-4b63-afdd-de436ab54e60 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:46.738506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21870a4-8329-4b63-afdd-de436ab54e60 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:46.739222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21870a4-8329-4b63-afdd-de436ab54e60 None admin] RBAC: Adding query filter params (name=member) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:46.739722 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21870a4-8329-4b63-afdd-de436ab54e60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:46.741290 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21870a4-8329-4b63-afdd-de436ab54e60 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:46.745456 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-f5eecc35-22dd-4615-8df1-2b5a7a25080a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:03:46.745456 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:46.745456 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:46.745456 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:46.745456 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:46.745456 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:46.745456 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:46.745456 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:46.745456 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:46.745456 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:46.745456 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:46.745456 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:46.745456 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:46.745456 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:46.745456 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:46.745456 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:46.746342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:46.746342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:46.746342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:46.746342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:46.746342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:46.746342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:46.746342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:46.746342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:46.746342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:46.746342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:46.746342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:46.746342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:46.746342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:46.746342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:46.746342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:46.746342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:46.747104 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:46.747104 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:46.747104 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:46.747104 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:46.747104 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:46.747104 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:46.747104 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:46.747104 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:46.747104 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:46.747104 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:46.747104 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:03:46.747104 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:03:46.749968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 83/162] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Jul 28 11:03:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:03:46.751976 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf8e53-8438-46c1-beaa-9665c0fd31b7 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:46.752507 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf8e53-8438-46c1-beaa-9665c0fd31b7 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:46.753019 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf8e53-8438-46c1-beaa-9665c0fd31b7 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:46.754605 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 84/163] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:46.756063 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 80/164] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:03:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:46.761038 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ab503-824b-4337-aba0-f970e8dfd696 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:46.761581 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ab503-824b-4337-aba0-f970e8dfd696 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:46.761941 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21870a4-8329-4b63-afdd-de436ab54e60 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:46.762255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ab503-824b-4337-aba0-f970e8dfd696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:46.782724 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-bb0ab503-824b-4337-aba0-f970e8dfd696 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:46.784267 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-bb0ab503-824b-4337-aba0-f970e8dfd696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:46.839704 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:46.858768 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:46.875103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 85/165] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:46.877064 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ab503-824b-4337-aba0-f970e8dfd696 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:46.927145 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21870a4-8329-4b63-afdd-de436ab54e60 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:46.969353 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4010d-b267-44ab-b182-02b66748aac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:46.970355 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4010d-b267-44ab-b182-02b66748aac0 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:46.970868 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4010d-b267-44ab-b182-02b66748aac0 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:46.971366 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4010d-b267-44ab-b182-02b66748aac0 None admin] PATH_INFO: `/v3/users/ed549f7c8f5d4711bcb4f60dff8f3746` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:46.972829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4010d-b267-44ab-b182-02b66748aac0 None admin] RBAC: Authorizing `identity:get_user(user_id=ed549f7c8f5d4711bcb4f60dff8f3746)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:46.974519 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4010d-b267-44ab-b182-02b66748aac0 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:46.977251 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 81/166] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:46 2022] GET /identity/v3/users/ed549f7c8f5d4711bcb4f60dff8f3746 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:03:46.978250 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4010d-b267-44ab-b182-02b66748aac0 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:47.016408 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ab503-824b-4337-aba0-f970e8dfd696 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:47.053378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0175c-f858-4407-bf43-68cbc84d6520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:47.053890 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0175c-f858-4407-bf43-68cbc84d6520 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:47.054176 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0175c-f858-4407-bf43-68cbc84d6520 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:47.054454 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0175c-f858-4407-bf43-68cbc84d6520 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:47.055257 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0175c-f858-4407-bf43-68cbc84d6520 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:47.055644 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0175c-f858-4407-bf43-68cbc84d6520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:47.057005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0175c-f858-4407-bf43-68cbc84d6520 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:47.066285 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 86/167] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:47.072132 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0175c-f858-4407-bf43-68cbc84d6520 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:47.092900 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4010d-b267-44ab-b182-02b66748aac0 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:47.109666 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:47.131650 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd64e3-cd14-4972-854e-ec54953deb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:47.132669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd64e3-cd14-4972-854e-ec54953deb3d None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:47.133649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd64e3-cd14-4972-854e-ec54953deb3d None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:47.134105 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd64e3-cd14-4972-854e-ec54953deb3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:47.137733 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:47.148254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd64e3-cd14-4972-854e-ec54953deb3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:47.155126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-85cd64e3-cd14-4972-854e-ec54953deb3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:03:47.155126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:47.155126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:47.155126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:47.155126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:47.155126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:47.155126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:47.155126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:47.155126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:47.155126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:47.155126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:47.155126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:47.155126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:47.155126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:47.155126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:47.155126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:47.156215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:47.156215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:47.156215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:47.156215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:47.156215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:47.156215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:47.156215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:47.156215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:47.156215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:47.156215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:47.156215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:47.156215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:47.156215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:47.156215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:47.156215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:47.156215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:47.157084 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:47.157084 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:47.157084 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:47.157084 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:47.157084 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:47.157084 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:47.157084 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:47.157084 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:47.157084 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:47.157084 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:47.157084 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:03:47.157084 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:03:47.159676 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 82/168] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:03:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:47.160680 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd64e3-cd14-4972-854e-ec54953deb3d None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:47.188576 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0175c-f858-4407-bf43-68cbc84d6520 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:47.245442 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daa865-064c-461c-8cd0-037032dee5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:47.245992 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daa865-064c-461c-8cd0-037032dee5fb None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:47.246269 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daa865-064c-461c-8cd0-037032dee5fb None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:47.246542 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daa865-064c-461c-8cd0-037032dee5fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:47.303454 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd64e3-cd14-4972-854e-ec54953deb3d None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:47.348533 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2daa865-064c-461c-8cd0-037032dee5fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:47.350662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2daa865-064c-461c-8cd0-037032dee5fb None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:47.352136 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e20043-3fa5-45c4-8f8f-d0b4c93186d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:47.353534 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e20043-3fa5-45c4-8f8f-d0b4c93186d9 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:47.355093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e20043-3fa5-45c4-8f8f-d0b4c93186d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:47.355659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e20043-3fa5-45c4-8f8f-d0b4c93186d9 None admin] PATH_INFO: `/v3/users/5277cece91a843118766eb0b5a214210` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:47.357261 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e20043-3fa5-45c4-8f8f-d0b4c93186d9 None admin] RBAC: Authorizing `identity:get_user(user_id=5277cece91a843118766eb0b5a214210)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:47.359006 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e20043-3fa5-45c4-8f8f-d0b4c93186d9 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:47.360970 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 83/169] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:47 2022] GET /identity/v3/users/5277cece91a843118766eb0b5a214210 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:47.362165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e20043-3fa5-45c4-8f8f-d0b4c93186d9 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:47.420021 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:47.487646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:47.542816 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 87/170] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:03:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:47.543631 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daa865-064c-461c-8cd0-037032dee5fb None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:47.559042 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e20043-3fa5-45c4-8f8f-d0b4c93186d9 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:47.624583 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0510db4-65c2-4bbb-90aa-48324615f3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:47.625229 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0510db4-65c2-4bbb-90aa-48324615f3eb None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:47.625511 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0510db4-65c2-4bbb-90aa-48324615f3eb None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:47.625788 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0510db4-65c2-4bbb-90aa-48324615f3eb None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:47.626522 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0510db4-65c2-4bbb-90aa-48324615f3eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:47.626825 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0510db4-65c2-4bbb-90aa-48324615f3eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:47.628276 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0510db4-65c2-4bbb-90aa-48324615f3eb None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:47.643217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 84/171] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:03:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:47.645021 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0510db4-65c2-4bbb-90aa-48324615f3eb None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:47.762540 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daa865-064c-461c-8cd0-037032dee5fb None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:47.856604 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e648d84-d9a5-45a4-aa8a-334e2757d29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:47.857250 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e648d84-d9a5-45a4-aa8a-334e2757d29e None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:47.857532 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e648d84-d9a5-45a4-aa8a-334e2757d29e None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:47.857812 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e648d84-d9a5-45a4-aa8a-334e2757d29e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:47.862643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:47.884158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0510db4-65c2-4bbb-90aa-48324615f3eb None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:47.964526 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:47.994778 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e648d84-d9a5-45a4-aa8a-334e2757d29e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:47.996457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e648d84-d9a5-45a4-aa8a-334e2757d29e None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:48.004160 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b055a67-12e4-4188-aa75-cd2f22fd7535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:48.004858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b055a67-12e4-4188-aa75-cd2f22fd7535 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:48.005148 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b055a67-12e4-4188-aa75-cd2f22fd7535 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:48.005431 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b055a67-12e4-4188-aa75-cd2f22fd7535 None admin] PATH_INFO: `/v3/projects/c5f8fd499932493c99d06f9a58854406` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:48.012160 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b055a67-12e4-4188-aa75-cd2f22fd7535 None admin] RBAC: Authorizing `identity:get_project(project_id=c5f8fd499932493c99d06f9a58854406)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:48.013689 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b055a67-12e4-4188-aa75-cd2f22fd7535 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:48.015730 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 85/172] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:47 2022] GET /identity/v3/projects/c5f8fd499932493c99d06f9a58854406 => generated 312 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:48.016295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b055a67-12e4-4188-aa75-cd2f22fd7535 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:48.224193 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 88/173] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:03:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:48.225000 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e648d84-d9a5-45a4-aa8a-334e2757d29e None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:48.287207 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b055a67-12e4-4188-aa75-cd2f22fd7535 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:48.287561 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:48.404047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60077b3-0cef-4c5f-a6e5-c078d3c443a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:48.404733 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60077b3-0cef-4c5f-a6e5-c078d3c443a8 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:48.405023 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60077b3-0cef-4c5f-a6e5-c078d3c443a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:48.405302 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60077b3-0cef-4c5f-a6e5-c078d3c443a8 None admin] PATH_INFO: `/v3/users/ed549f7c8f5d4711bcb4f60dff8f3746` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:48.406594 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60077b3-0cef-4c5f-a6e5-c078d3c443a8 None admin] RBAC: Authorizing `identity:get_user(user_id=ed549f7c8f5d4711bcb4f60dff8f3746)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:48.408101 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60077b3-0cef-4c5f-a6e5-c078d3c443a8 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:48.409749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 86/174] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:48 2022] GET /identity/v3/users/ed549f7c8f5d4711bcb4f60dff8f3746 => generated 275 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:48.410529 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60077b3-0cef-4c5f-a6e5-c078d3c443a8 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:48.462695 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e648d84-d9a5-45a4-aa8a-334e2757d29e None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:48.543743 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:48.561635 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41769cbe-875c-4fc6-8110-c320801e1030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:48.562271 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41769cbe-875c-4fc6-8110-c320801e1030 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:48.562557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41769cbe-875c-4fc6-8110-c320801e1030 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:48.562838 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41769cbe-875c-4fc6-8110-c320801e1030 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:48.563684 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41769cbe-875c-4fc6-8110-c320801e1030 None admin] RBAC: Adding query filter params (role.id=05bb46007d644829b12b0d4ded0bd8d2, scope.project.id=c5f8fd499932493c99d06f9a58854406, user.id=ed549f7c8f5d4711bcb4f60dff8f3746) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:48.563999 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41769cbe-875c-4fc6-8110-c320801e1030 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:48.565462 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41769cbe-875c-4fc6-8110-c320801e1030 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:48.572531 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 89/175] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:03:48 2022] GET /identity/v3/role_assignments?user.id=ed549f7c8f5d4711bcb4f60dff8f3746&scope.project.id=c5f8fd499932493c99d06f9a58854406&role.id=05bb46007d644829b12b0d4ded0bd8d2 => generated 608 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:48.573386 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41769cbe-875c-4fc6-8110-c320801e1030 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:48.583641 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60077b3-0cef-4c5f-a6e5-c078d3c443a8 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:48.631791 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ce9a1-8fc2-4b4c-b022-92ba7d8fd98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:48.632478 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ce9a1-8fc2-4b4c-b022-92ba7d8fd98a None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:48.633281 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ce9a1-8fc2-4b4c-b022-92ba7d8fd98a None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:48.633568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ce9a1-8fc2-4b4c-b022-92ba7d8fd98a None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:48.635561 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ce9a1-8fc2-4b4c-b022-92ba7d8fd98a None admin] RBAC: Authorizing `identity:get_project(project_id=19ee209183e74289b7ddcfce7e067a7a)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:48.637069 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ce9a1-8fc2-4b4c-b022-92ba7d8fd98a None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:48.638826 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 87/176] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:48 2022] GET /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:48.640117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea189d0-46e3-4cab-93ff-446a15d50743 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:48.640364 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea189d0-46e3-4cab-93ff-446a15d50743 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:48.640640 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea189d0-46e3-4cab-93ff-446a15d50743 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:48.642031 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 88/177] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:48.651355 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80a5a3-327f-48cc-9027-a892772b2e63 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:48.651649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80a5a3-327f-48cc-9027-a892772b2e63 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:48.651923 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80a5a3-327f-48cc-9027-a892772b2e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:48.687365 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-eb80a5a3-327f-48cc-9027-a892772b2e63 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:48.688670 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-eb80a5a3-327f-48cc-9027-a892772b2e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:48.713025 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:48.718069 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41769cbe-875c-4fc6-8110-c320801e1030 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:48.761090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4bb5e-1ee9-4284-be30-759bb5633634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:48.761734 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4bb5e-1ee9-4284-be30-759bb5633634 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:48.762020 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4bb5e-1ee9-4284-be30-759bb5633634 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:48.762302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4bb5e-1ee9-4284-be30-759bb5633634 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:48.844036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4bb5e-1ee9-4284-be30-759bb5633634 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:48.845582 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4bb5e-1ee9-4284-be30-759bb5633634 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:48.936373 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 89/178] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:48.937272 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80a5a3-327f-48cc-9027-a892772b2e63 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:48.966228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 90/179] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:03:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:48.966883 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:48.972858 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4bb5e-1ee9-4284-be30-759bb5633634 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:49.090174 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4bb5e-1ee9-4284-be30-759bb5633634 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:49.130228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d63ffd-4345-46d1-b3a3-aec8beaa0298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:49.131227 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d63ffd-4345-46d1-b3a3-aec8beaa0298 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:49.131850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d63ffd-4345-46d1-b3a3-aec8beaa0298 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:49.132315 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d63ffd-4345-46d1-b3a3-aec8beaa0298 None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:49.133942 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d63ffd-4345-46d1-b3a3-aec8beaa0298 None admin] RBAC: Authorizing `identity:get_project(project_id=19ee209183e74289b7ddcfce7e067a7a)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:49.136298 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d63ffd-4345-46d1-b3a3-aec8beaa0298 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:49.138658 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 91/180] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:48 2022] GET /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:49.139736 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d63ffd-4345-46d1-b3a3-aec8beaa0298 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:49.156887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:49.219631 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:49.266185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d63ffd-4345-46d1-b3a3-aec8beaa0298 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:49.284782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80a5a3-327f-48cc-9027-a892772b2e63 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:49.317044 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db54172-f2dc-4ebd-9df0-335151f98f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:49.318565 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db54172-f2dc-4ebd-9df0-335151f98f47 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:49.319363 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db54172-f2dc-4ebd-9df0-335151f98f47 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:49.320071 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db54172-f2dc-4ebd-9df0-335151f98f47 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:49.332438 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d7a9c-327e-4501-a8b5-f8c66d6c8caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:49.333184 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d7a9c-327e-4501-a8b5-f8c66d6c8caf None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:49.333529 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d7a9c-327e-4501-a8b5-f8c66d6c8caf None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:49.333887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d7a9c-327e-4501-a8b5-f8c66d6c8caf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:49.334759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d7a9c-327e-4501-a8b5-f8c66d6c8caf None admin] RBAC: Adding query filter params (role.id=f2a8452a65264f9ea10467160b1bd735, scope.project.id=19ee209183e74289b7ddcfce7e067a7a, user.id=5277cece91a843118766eb0b5a214210) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:49.335137 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d7a9c-327e-4501-a8b5-f8c66d6c8caf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:49.336996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d7a9c-327e-4501-a8b5-f8c66d6c8caf None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:49.344367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 90/181] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:03:48 2022] GET /identity/v3/role_assignments?user.id=5277cece91a843118766eb0b5a214210&scope.project.id=19ee209183e74289b7ddcfce7e067a7a&role.id=f2a8452a65264f9ea10467160b1bd735 => generated 608 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:49.345109 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d7a9c-327e-4501-a8b5-f8c66d6c8caf None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:49.346136 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db54172-f2dc-4ebd-9df0-335151f98f47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:49.358430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-6db54172-f2dc-4ebd-9df0-335151f98f47 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 11:03:49.358430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:49.358430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:49.358430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:49.358430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:49.358430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:49.358430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:49.358430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:49.358430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:49.358430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:49.358430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:49.358430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:49.358430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:49.358430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:49.358430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:49.358430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:49.360249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:49.360249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:49.360249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:49.360249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:49.360249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:49.360249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:49.360249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:49.360249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:49.360249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:49.360249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:49.360249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:49.360249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:49.360249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:49.360249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:49.360249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:49.360249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:49.361886 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:49.361886 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:49.361886 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:49.361886 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:49.361886 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:49.361886 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:49.361886 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:49.361886 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:49.361886 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:49.361886 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:49.361886 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 11:03:49.361886 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:03:49.377988 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 92/182] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:49.379902 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed5091-d9f7-4b24-983b-eee1f907782d None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:49.380366 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed5091-d9f7-4b24-983b-eee1f907782d None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:49.380688 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed5091-d9f7-4b24-983b-eee1f907782d None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:49.382464 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 93/183] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:49.391466 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed5091-d9f7-4b24-983b-eee1f907782d None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:49.590257 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d7a9c-327e-4501-a8b5-f8c66d6c8caf None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:49.622964 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed5091-d9f7-4b24-983b-eee1f907782d None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:49.629281 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:49.648507 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a189b-23e8-4953-80c2-fa24d16585dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:49.649303 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a189b-23e8-4953-80c2-fa24d16585dd None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:49.649430 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a189b-23e8-4953-80c2-fa24d16585dd None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:49.649690 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a189b-23e8-4953-80c2-fa24d16585dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:49.650489 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a189b-23e8-4953-80c2-fa24d16585dd None admin] RBAC: Adding query filter params (role.id=e1248e4ba8a34052820e6bd72cdd8b72, scope.project.id=19ee209183e74289b7ddcfce7e067a7a, user.id=ed549f7c8f5d4711bcb4f60dff8f3746) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:49.650800 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a189b-23e8-4953-80c2-fa24d16585dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:49.652321 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a189b-23e8-4953-80c2-fa24d16585dd None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:49.659850 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 91/184] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:03:49 2022] GET /identity/v3/role_assignments?user.id=ed549f7c8f5d4711bcb4f60dff8f3746&scope.project.id=19ee209183e74289b7ddcfce7e067a7a&role.id=e1248e4ba8a34052820e6bd72cdd8b72 => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:49.661099 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f297f3d-9851-44a9-9ed6-739128253b3e None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:49.661382 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f297f3d-9851-44a9-9ed6-739128253b3e None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:49.661745 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f297f3d-9851-44a9-9ed6-739128253b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:49.667202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:49.692275 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fe683-ddf0-46b1-94f5-fe70f85bb638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:49.694099 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fe683-ddf0-46b1-94f5-fe70f85bb638 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:49.694403 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fe683-ddf0-46b1-94f5-fe70f85bb638 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:49.694680 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fe683-ddf0-46b1-94f5-fe70f85bb638 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:49.695525 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fe683-ddf0-46b1-94f5-fe70f85bb638 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:49.695832 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fe683-ddf0-46b1-94f5-fe70f85bb638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:49.697262 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fe683-ddf0-46b1-94f5-fe70f85bb638 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:49.710004 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-5f297f3d-9851-44a9-9ed6-739128253b3e None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:49.711839 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-5f297f3d-9851-44a9-9ed6-739128253b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:49.717868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 94/185] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:03:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:49.725024 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fe683-ddf0-46b1-94f5-fe70f85bb638 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:49.814625 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 92/186] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:49.848143 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f297f3d-9851-44a9-9ed6-739128253b3e None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:49.864168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fe683-ddf0-46b1-94f5-fe70f85bb638 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:49.901979 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c09a6d-0aaf-4a74-a68a-56d47a673a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:49.902561 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c09a6d-0aaf-4a74-a68a-56d47a673a97 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:49.902895 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c09a6d-0aaf-4a74-a68a-56d47a673a97 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:49.903181 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c09a6d-0aaf-4a74-a68a-56d47a673a97 None admin] PATH_INFO: `/v3/users/9b922f2849d345599c0e141f7bdde9e6` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:49.905041 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c09a6d-0aaf-4a74-a68a-56d47a673a97 None admin] RBAC: Authorizing `identity:get_user(user_id=9b922f2849d345599c0e141f7bdde9e6)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:49.905987 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c09a6d-0aaf-4a74-a68a-56d47a673a97 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:49.911139 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 95/187] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:49 2022] GET /identity/v3/users/9b922f2849d345599c0e141f7bdde9e6 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:03:49.920472 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c09a6d-0aaf-4a74-a68a-56d47a673a97 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:49.987175 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f297f3d-9851-44a9-9ed6-739128253b3e None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:49.998287 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:50.012624 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:50.035089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cc184-1c9b-47a3-b545-37f4af0c47f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:50.036050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cc184-1c9b-47a3-b545-37f4af0c47f9 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:50.036564 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cc184-1c9b-47a3-b545-37f4af0c47f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:50.037028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cc184-1c9b-47a3-b545-37f4af0c47f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:50.050421 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cc184-1c9b-47a3-b545-37f4af0c47f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:50.055091 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c09a6d-0aaf-4a74-a68a-56d47a673a97 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:50.055749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-b38cc184-1c9b-47a3-b545-37f4af0c47f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:03:50.055749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:50.055749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:50.055749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:50.055749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:50.055749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:50.055749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:50.055749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:50.055749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:50.055749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:50.055749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:50.055749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:50.055749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:50.055749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:50.055749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:50.055749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:50.056585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:50.056585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:50.056585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:50.056585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:50.056585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:50.056585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:50.056585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:50.056585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:50.056585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:50.056585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:50.056585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:50.056585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:50.056585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:50.056585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:50.056585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:50.056585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:50.057355 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:50.057355 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:50.057355 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:50.057355 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:50.057355 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:50.057355 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:50.057355 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:50.057355 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:50.057355 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:50.057355 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:50.057355 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:03:50.057355 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:03:50.057355 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 93/188] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Jul 28 11:03:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:03:50.066035 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cc184-1c9b-47a3-b545-37f4af0c47f9 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:50.111992 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f6e81-e6a1-407a-b376-97c57a31f17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:50.113026 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f6e81-e6a1-407a-b376-97c57a31f17a None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:50.113503 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f6e81-e6a1-407a-b376-97c57a31f17a None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:50.113971 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f6e81-e6a1-407a-b376-97c57a31f17a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:50.192094 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f6e81-e6a1-407a-b376-97c57a31f17a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:50.193897 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f6e81-e6a1-407a-b376-97c57a31f17a None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:50.194021 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cc184-1c9b-47a3-b545-37f4af0c47f9 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:50.233155 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e5a8e-4238-4b11-8110-0a84724e6a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:50.233783 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e5a8e-4238-4b11-8110-0a84724e6a5c None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:50.234069 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e5a8e-4238-4b11-8110-0a84724e6a5c None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:50.234358 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e5a8e-4238-4b11-8110-0a84724e6a5c None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:50.235064 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e5a8e-4238-4b11-8110-0a84724e6a5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:50.236552 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e5a8e-4238-4b11-8110-0a84724e6a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:50.236865 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e5a8e-4238-4b11-8110-0a84724e6a5c None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:50.248391 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 94/189] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:50.249522 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8632897-99d2-465e-a438-31ba4d70fcca None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:50.249816 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8632897-99d2-465e-a438-31ba4d70fcca None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:50.250099 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8632897-99d2-465e-a438-31ba4d70fcca None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:50.251531 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 95/190] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:50.257004 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1021fad-5fe8-4681-aa58-33235d1e3837 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:50.257164 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1021fad-5fe8-4681-aa58-33235d1e3837 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:50.257413 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1021fad-5fe8-4681-aa58-33235d1e3837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:50.264705 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:50.277157 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-f1021fad-5fe8-4681-aa58-33235d1e3837 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:50.278159 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-f1021fad-5fe8-4681-aa58-33235d1e3837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:50.314935 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:50.318308 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 96/191] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:03:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:50.319470 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f6e81-e6a1-407a-b376-97c57a31f17a None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:50.354315 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 96/192] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:03:50.355544 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1021fad-5fe8-4681-aa58-33235d1e3837 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:50.447554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f6e81-e6a1-407a-b376-97c57a31f17a None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:50.476600 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1021fad-5fe8-4681-aa58-33235d1e3837 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:50.488800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4d330-0986-41c8-8463-95e060c91c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:50.489819 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4d330-0986-41c8-8463-95e060c91c87 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:50.490103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4d330-0986-41c8-8463-95e060c91c87 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:50.490545 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4d330-0986-41c8-8463-95e060c91c87 None admin] PATH_INFO: `/v3/users/6079fb87a870416daad5f83020ec2431` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:50.505819 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4d330-0986-41c8-8463-95e060c91c87 None admin] RBAC: Authorizing `identity:get_user(user_id=6079fb87a870416daad5f83020ec2431)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:50.507301 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4d330-0986-41c8-8463-95e060c91c87 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:50.509393 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 97/193] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:50 2022] GET /identity/v3/users/6079fb87a870416daad5f83020ec2431 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:50.510595 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4d330-0986-41c8-8463-95e060c91c87 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:50.522372 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea7b2e-b93c-42c8-b006-d9c20ea8518c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:50.523860 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea7b2e-b93c-42c8-b006-d9c20ea8518c None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:50.524284 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea7b2e-b93c-42c8-b006-d9c20ea8518c None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:50.524829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea7b2e-b93c-42c8-b006-d9c20ea8518c None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:50.525998 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea7b2e-b93c-42c8-b006-d9c20ea8518c None admin] RBAC: Authorizing `identity:get_project(project_id=19ee209183e74289b7ddcfce7e067a7a)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:50.527607 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea7b2e-b93c-42c8-b006-d9c20ea8518c None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:50.528292 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:50.534935 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 97/194] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:50 2022] GET /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:50.536483 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea7b2e-b93c-42c8-b006-d9c20ea8518c None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:50.578973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:50.621359 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4d330-0986-41c8-8463-95e060c91c87 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:50.645654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea7b2e-b93c-42c8-b006-d9c20ea8518c None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:50.655948 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fcc16-d439-4115-b3c1-eb7bdce38607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:50.656592 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fcc16-d439-4115-b3c1-eb7bdce38607 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:50.656877 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fcc16-d439-4115-b3c1-eb7bdce38607 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:50.657151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fcc16-d439-4115-b3c1-eb7bdce38607 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:50.668399 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fcc16-d439-4115-b3c1-eb7bdce38607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:50.673378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-d40fcc16-d439-4115-b3c1-eb7bdce38607 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:03:50.673378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:50.673378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:50.673378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:50.673378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:50.673378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:50.673378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:50.673378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:50.673378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:50.673378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:50.673378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:50.673378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:50.673378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:50.673378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:50.673378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:50.673378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:50.674500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:50.674500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:50.674500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:50.674500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:50.674500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:50.674500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:50.674500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:50.674500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:50.674500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:50.674500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:50.674500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:50.674500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:50.674500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:50.674500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:50.674500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:50.674500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:50.680379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:50.680379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:50.680379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:50.680379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:50.680379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:50.680379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:50.680379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:50.680379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:50.680379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:50.680379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:50.680379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:03:50.680379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:03:50.680379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 98/195] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:03:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:50.680379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fcc16-d439-4115-b3c1-eb7bdce38607 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:50.682095 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84323eb-7289-4a95-b6de-887ef1ece7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:50.682728 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84323eb-7289-4a95-b6de-887ef1ece7fb None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:50.683011 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84323eb-7289-4a95-b6de-887ef1ece7fb None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:50.683321 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84323eb-7289-4a95-b6de-887ef1ece7fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:50.753078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:50.753456 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84323eb-7289-4a95-b6de-887ef1ece7fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:50.755007 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84323eb-7289-4a95-b6de-887ef1ece7fb None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:50.780083 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fcc16-d439-4115-b3c1-eb7bdce38607 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:50.795631 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:50.815785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857077ab-897b-4786-b9b2-4227045065a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:50.816414 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857077ab-897b-4786-b9b2-4227045065a2 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:50.816697 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857077ab-897b-4786-b9b2-4227045065a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:50.816977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857077ab-897b-4786-b9b2-4227045065a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:50.817776 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857077ab-897b-4786-b9b2-4227045065a2 None admin] RBAC: Adding query filter params (role.id=c29fdaefa55648b582d687cc5541fb3e, scope.project.id=19ee209183e74289b7ddcfce7e067a7a, user.id=9b922f2849d345599c0e141f7bdde9e6) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:50.818090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857077ab-897b-4786-b9b2-4227045065a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:50.819581 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857077ab-897b-4786-b9b2-4227045065a2 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:50.826838 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 99/196] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:03:50 2022] GET /identity/v3/role_assignments?user.id=9b922f2849d345599c0e141f7bdde9e6&scope.project.id=19ee209183e74289b7ddcfce7e067a7a&role.id=c29fdaefa55648b582d687cc5541fb3e => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:50.827307 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f099f26-a69a-470f-bc3c-40ec038e08c8 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:50.827601 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f099f26-a69a-470f-bc3c-40ec038e08c8 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:50.827880 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f099f26-a69a-470f-bc3c-40ec038e08c8 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:50.829338 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 100/197] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:50.829918 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f099f26-a69a-470f-bc3c-40ec038e08c8 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:50.871437 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 98/198] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:03:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:50.873160 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c5b4f-b326-4257-b459-768ea994ed77 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:50.873658 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c5b4f-b326-4257-b459-768ea994ed77 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:50.874151 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c5b4f-b326-4257-b459-768ea994ed77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:50.895374 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-c67c5b4f-b326-4257-b459-768ea994ed77 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:50.896653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-c67c5b4f-b326-4257-b459-768ea994ed77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:50.957386 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f099f26-a69a-470f-bc3c-40ec038e08c8 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:50.975692 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 99/199] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:50.977097 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c5b4f-b326-4257-b459-768ea994ed77 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:51.005379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba46f0-8b05-4a95-a603-16dacb147253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:51.005928 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba46f0-8b05-4a95-a603-16dacb147253 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:51.006216 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba46f0-8b05-4a95-a603-16dacb147253 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:51.006496 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba46f0-8b05-4a95-a603-16dacb147253 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:51.007234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba46f0-8b05-4a95-a603-16dacb147253 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:51.007634 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba46f0-8b05-4a95-a603-16dacb147253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:51.009071 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba46f0-8b05-4a95-a603-16dacb147253 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:51.015397 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:51.020551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 101/200] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:03:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:51.021543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba46f0-8b05-4a95-a603-16dacb147253 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:51.075542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:51.112329 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c5b4f-b326-4257-b459-768ea994ed77 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:51.138574 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba46f0-8b05-4a95-a603-16dacb147253 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:51.148680 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54f605-7510-4702-b940-dad7fd36ace7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:51.149420 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54f605-7510-4702-b940-dad7fd36ace7 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:51.149703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54f605-7510-4702-b940-dad7fd36ace7 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:51.149979 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54f605-7510-4702-b940-dad7fd36ace7 None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:51.151152 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54f605-7510-4702-b940-dad7fd36ace7 None admin] RBAC: Authorizing `identity:get_project(project_id=638dc1c8e7a34375b96fb45f061210f0)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:51.152656 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54f605-7510-4702-b940-dad7fd36ace7 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:51.154484 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 100/201] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:50 2022] GET /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:51.155085 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54f605-7510-4702-b940-dad7fd36ace7 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:51.177461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12ac57-2d44-4d4f-9e93-a55d91dcb403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:51.178114 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12ac57-2d44-4d4f-9e93-a55d91dcb403 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:51.178396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12ac57-2d44-4d4f-9e93-a55d91dcb403 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:51.178671 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12ac57-2d44-4d4f-9e93-a55d91dcb403 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:51.180352 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12ac57-2d44-4d4f-9e93-a55d91dcb403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:51.181804 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12ac57-2d44-4d4f-9e93-a55d91dcb403 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:51.183605 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 102/202] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:03:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:51.184205 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12ac57-2d44-4d4f-9e93-a55d91dcb403 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:51.252076 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:51.257575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54f605-7510-4702-b940-dad7fd36ace7 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:51.286745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12ac57-2d44-4d4f-9e93-a55d91dcb403 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:51.292489 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31760bdb-e1d6-4cf9-809a-adcd1846ce48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:51.293141 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31760bdb-e1d6-4cf9-809a-adcd1846ce48 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:51.293419 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31760bdb-e1d6-4cf9-809a-adcd1846ce48 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:51.293694 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31760bdb-e1d6-4cf9-809a-adcd1846ce48 None admin] PATH_INFO: `/v3/users/6079fb87a870416daad5f83020ec2431` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:51.294873 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31760bdb-e1d6-4cf9-809a-adcd1846ce48 None admin] RBAC: Authorizing `identity:get_user(user_id=6079fb87a870416daad5f83020ec2431)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:51.296367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31760bdb-e1d6-4cf9-809a-adcd1846ce48 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:51.298138 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 101/203] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:51 2022] GET /identity/v3/users/6079fb87a870416daad5f83020ec2431 => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:51.298722 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31760bdb-e1d6-4cf9-809a-adcd1846ce48 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:51.302917 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:51.327647 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70187dc2-b9c4-4502-a005-03ace8989e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:51.328276 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70187dc2-b9c4-4502-a005-03ace8989e6c None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:51.328565 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70187dc2-b9c4-4502-a005-03ace8989e6c None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:51.328839 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70187dc2-b9c4-4502-a005-03ace8989e6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:51.329625 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70187dc2-b9c4-4502-a005-03ace8989e6c None admin] RBAC: Adding query filter params (role.id=f2a8452a65264f9ea10467160b1bd735, scope.project.id=638dc1c8e7a34375b96fb45f061210f0, user.id=6079fb87a870416daad5f83020ec2431) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:51.329935 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70187dc2-b9c4-4502-a005-03ace8989e6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:51.331417 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70187dc2-b9c4-4502-a005-03ace8989e6c None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:51.340421 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 103/204] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:03:51 2022] GET /identity/v3/role_assignments?user.id=6079fb87a870416daad5f83020ec2431&scope.project.id=638dc1c8e7a34375b96fb45f061210f0&role.id=f2a8452a65264f9ea10467160b1bd735 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:51.341270 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70187dc2-b9c4-4502-a005-03ace8989e6c None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:51.432537 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31760bdb-e1d6-4cf9-809a-adcd1846ce48 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:51.474430 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b5e23-7996-4fcb-8079-6600b4c43117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:51.475073 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b5e23-7996-4fcb-8079-6600b4c43117 None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:51.475390 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b5e23-7996-4fcb-8079-6600b4c43117 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:51.475670 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b5e23-7996-4fcb-8079-6600b4c43117 None admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:51.476371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b5e23-7996-4fcb-8079-6600b4c43117 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:51.478465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b5e23-7996-4fcb-8079-6600b4c43117 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:51.491760 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70187dc2-b9c4-4502-a005-03ace8989e6c None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:51.515391 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 102/205] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Jul 28 11:03:51 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:03:51.528660 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:51.536597 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33f4f6-79f5-4bb5-8374-6bcc86b9f30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:51.537384 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33f4f6-79f5-4bb5-8374-6bcc86b9f30d None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:51.537825 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33f4f6-79f5-4bb5-8374-6bcc86b9f30d None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:51.538198 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33f4f6-79f5-4bb5-8374-6bcc86b9f30d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:51.624132 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33f4f6-79f5-4bb5-8374-6bcc86b9f30d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:51.625931 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33f4f6-79f5-4bb5-8374-6bcc86b9f30d None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:51.749872 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 104/206] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:03:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:51.756196 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b5e23-7996-4fcb-8079-6600b4c43117 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:51.839482 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:51.901791 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b5e23-7996-4fcb-8079-6600b4c43117 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:51.942348 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140e50e-1ec3-416f-a472-664daff0fe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:51.943149 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140e50e-1ec3-416f-a472-664daff0fe0c None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:51.943467 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140e50e-1ec3-416f-a472-664daff0fe0c None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:51.943747 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140e50e-1ec3-416f-a472-664daff0fe0c None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:51.945043 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140e50e-1ec3-416f-a472-664daff0fe0c None admin] RBAC: Authorizing `identity:get_project(project_id=638dc1c8e7a34375b96fb45f061210f0)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:51.946575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140e50e-1ec3-416f-a472-664daff0fe0c None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:51.948815 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 103/207] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:51 2022] GET /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:51.954814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33f4f6-79f5-4bb5-8374-6bcc86b9f30d None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:51.991128 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:52.079724 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33f4f6-79f5-4bb5-8374-6bcc86b9f30d None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:52.119340 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0b7a3-dc1e-4acc-b2dc-c57a4759b2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:52.119902 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0b7a3-dc1e-4acc-b2dc-c57a4759b2c0 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:52.120181 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0b7a3-dc1e-4acc-b2dc-c57a4759b2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:52.120459 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0b7a3-dc1e-4acc-b2dc-c57a4759b2c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:52.121259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0b7a3-dc1e-4acc-b2dc-c57a4759b2c0 None admin] RBAC: Adding query filter params (role.id=e1248e4ba8a34052820e6bd72cdd8b72, scope.project.id=638dc1c8e7a34375b96fb45f061210f0, user.id=6079fb87a870416daad5f83020ec2431) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:52.121567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0b7a3-dc1e-4acc-b2dc-c57a4759b2c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:52.123231 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0b7a3-dc1e-4acc-b2dc-c57a4759b2c0 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:52.130483 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 105/208] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:03:51 2022] GET /identity/v3/role_assignments?user.id=6079fb87a870416daad5f83020ec2431&scope.project.id=638dc1c8e7a34375b96fb45f061210f0&role.id=e1248e4ba8a34052820e6bd72cdd8b72 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:53.646038 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8ab8f-5e07-4320-8d96-0c3f01ab2cff None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:53.646546 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8ab8f-5e07-4320-8d96-0c3f01ab2cff None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:53.646964 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8ab8f-5e07-4320-8d96-0c3f01ab2cff None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:53.650172 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 104/209] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:53.659753 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712ca19-29af-4004-a2c0-cc771817f6e2 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:53.661002 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712ca19-29af-4004-a2c0-cc771817f6e2 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:53.661565 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712ca19-29af-4004-a2c0-cc771817f6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:53.681986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-4712ca19-29af-4004-a2c0-cc771817f6e2 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:53.683620 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-4712ca19-29af-4004-a2c0-cc771817f6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:53.759365 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 106/210] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:53.779841 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8ab8f-5e07-4320-8d96-0c3f01ab2cff None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:53.900473 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8ab8f-5e07-4320-8d96-0c3f01ab2cff None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:53.928192 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:53.943697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35764a3c-2f6d-425e-82e0-16d131e9ebc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:53.944402 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35764a3c-2f6d-425e-82e0-16d131e9ebc5 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:53.944688 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35764a3c-2f6d-425e-82e0-16d131e9ebc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:53.944967 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35764a3c-2f6d-425e-82e0-16d131e9ebc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:53.957906 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35764a3c-2f6d-425e-82e0-16d131e9ebc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:53.963114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-35764a3c-2f6d-425e-82e0-16d131e9ebc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:03:53.963114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:53.963114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:53.963114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:53.963114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:53.963114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:53.963114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:53.963114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:53.963114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:53.963114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:53.963114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:53.963114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:53.963114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:53.963114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:53.963114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:53.963114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:53.964013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:53.964013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:53.964013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:53.964013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:53.964013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:53.964013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:53.964013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:53.964013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:53.964013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:53.964013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:53.964013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:53.964013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:53.964013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:53.964013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:53.964013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:53.964013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:53.964781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:53.964781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:53.964781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:53.964781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:53.964781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:53.964781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:53.964781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:53.964781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:53.964781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:53.964781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:53.964781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:03:53.964781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:03:53.964781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 105/211] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Jul 28 11:03:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:53.971653 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712ca19-29af-4004-a2c0-cc771817f6e2 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:54.005299 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:54.018676 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acf519-98ea-40db-a019-0349d8c0deae None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:54.018991 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acf519-98ea-40db-a019-0349d8c0deae None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:54.019233 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acf519-98ea-40db-a019-0349d8c0deae None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:54.020846 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 106/212] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:03:54.027161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aa575-cad9-4750-8c84-f00f30747c3a None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:54.027489 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aa575-cad9-4750-8c84-f00f30747c3a None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:54.027761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aa575-cad9-4750-8c84-f00f30747c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:54.048733 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-bc8aa575-cad9-4750-8c84-f00f30747c3a None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:54.050496 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-bc8aa575-cad9-4750-8c84-f00f30747c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:54.097731 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712ca19-29af-4004-a2c0-cc771817f6e2 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:54.135478 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d631fe-0c06-48d5-8427-b09423d9e9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:54.136442 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d631fe-0c06-48d5-8427-b09423d9e9d1 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:54.136894 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d631fe-0c06-48d5-8427-b09423d9e9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:54.137339 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d631fe-0c06-48d5-8427-b09423d9e9d1 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:54.138232 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d631fe-0c06-48d5-8427-b09423d9e9d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:54.138708 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d631fe-0c06-48d5-8427-b09423d9e9d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:54.140508 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d631fe-0c06-48d5-8427-b09423d9e9d1 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:54.143347 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 107/213] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:03:54.156109 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 107/214] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:54.161800 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8aa575-cad9-4750-8c84-f00f30747c3a None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:54.165006 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b03b77-bcd0-42a0-8404-d7785609747a None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:54.165556 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b03b77-bcd0-42a0-8404-d7785609747a None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:54.166031 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b03b77-bcd0-42a0-8404-d7785609747a None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:54.167865 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 108/215] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:54.171297 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b03b77-bcd0-42a0-8404-d7785609747a None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:54.270892 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:54.278175 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8aa575-cad9-4750-8c84-f00f30747c3a None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:54.290745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b03b77-bcd0-42a0-8404-d7785609747a None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:54.297922 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:54.321684 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087dc8b1-d986-426e-b090-ad438a4ff523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:54.322432 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dc8b1-d986-426e-b090-ad438a4ff523 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:54.322769 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dc8b1-d986-426e-b090-ad438a4ff523 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:54.323110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dc8b1-d986-426e-b090-ad438a4ff523 None admin] PATH_INFO: `/v3/users/6079fb87a870416daad5f83020ec2431` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:54.324382 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087dc8b1-d986-426e-b090-ad438a4ff523 None admin] RBAC: Authorizing `identity:get_user(user_id=6079fb87a870416daad5f83020ec2431)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:54.326090 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087dc8b1-d986-426e-b090-ad438a4ff523 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:54.327972 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 108/216] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:54 2022] GET /identity/v3/users/6079fb87a870416daad5f83020ec2431 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:54.328907 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f951c2-ea6e-43d1-98e8-2c378d3ea31e None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:54.329188 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f951c2-ea6e-43d1-98e8-2c378d3ea31e None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:54.329463 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f951c2-ea6e-43d1-98e8-2c378d3ea31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:54.337237 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fabb07-75d8-4180-9710-81cf50ff70dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:54.337910 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fabb07-75d8-4180-9710-81cf50ff70dc None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:54.338191 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fabb07-75d8-4180-9710-81cf50ff70dc None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:54.338483 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fabb07-75d8-4180-9710-81cf50ff70dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:54.347180 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-29f951c2-ea6e-43d1-98e8-2c378d3ea31e None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:54.348513 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-29f951c2-ea6e-43d1-98e8-2c378d3ea31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:54.350192 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fabb07-75d8-4180-9710-81cf50ff70dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:54.355772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-a7fabb07-75d8-4180-9710-81cf50ff70dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:03:54.355772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:54.355772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:54.355772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:54.355772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:54.355772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:54.355772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:54.355772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:54.355772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:54.355772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:54.355772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:54.355772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:54.355772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:54.355772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:54.355772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:54.355772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:54.356700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:54.356700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:54.356700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:54.356700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:54.356700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:54.356700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:54.356700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:54.356700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:54.356700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:54.356700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:54.356700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:54.356700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:54.356700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:54.356700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:54.356700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:54.356700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:54.357567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:54.357567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:54.357567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:54.357567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:54.357567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:54.357567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:54.357567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:54.357567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:54.357567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:54.357567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:54.357567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:03:54.357567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:03:54.357567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 109/217] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:03:54.359465 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fabb07-75d8-4180-9710-81cf50ff70dc None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:54.439546 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 109/218] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:54.440405 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f951c2-ea6e-43d1-98e8-2c378d3ea31e None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:54.469511 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fabb07-75d8-4180-9710-81cf50ff70dc None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:54.504936 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd77c5d-9a94-42c8-ae48-db109ae2df31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:54.505582 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd77c5d-9a94-42c8-ae48-db109ae2df31 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:54.505863 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd77c5d-9a94-42c8-ae48-db109ae2df31 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:54.506136 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd77c5d-9a94-42c8-ae48-db109ae2df31 None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:54.507315 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd77c5d-9a94-42c8-ae48-db109ae2df31 None admin] RBAC: Authorizing `identity:get_project(project_id=638dc1c8e7a34375b96fb45f061210f0)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:54.508841 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd77c5d-9a94-42c8-ae48-db109ae2df31 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:54.510758 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 110/219] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:54 2022] GET /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:54.511904 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c349c-2352-454c-80a2-d436f3471896 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:54.512191 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c349c-2352-454c-80a2-d436f3471896 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:54.512462 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c349c-2352-454c-80a2-d436f3471896 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:54.517628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 111/220] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:54.517628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c349c-2352-454c-80a2-d436f3471896 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:54.532551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:54.553296 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f951c2-ea6e-43d1-98e8-2c378d3ea31e None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:54.571539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:54.594964 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef096c6f-1143-43c5-b4eb-c631dde31fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:54.595627 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef096c6f-1143-43c5-b4eb-c631dde31fdb None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:54.595906 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef096c6f-1143-43c5-b4eb-c631dde31fdb None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:54.596180 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef096c6f-1143-43c5-b4eb-c631dde31fdb None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:54.596906 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef096c6f-1143-43c5-b4eb-c631dde31fdb None admin] RBAC: Adding query filter params (name=member) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:54.597210 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef096c6f-1143-43c5-b4eb-c631dde31fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:54.598608 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef096c6f-1143-43c5-b4eb-c631dde31fdb None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:54.607681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 110/221] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:03:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:54.608483 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef096c6f-1143-43c5-b4eb-c631dde31fdb None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:54.623974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c349c-2352-454c-80a2-d436f3471896 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:54.658782 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82afab-aebf-4ec5-8e45-b81c2dae8af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:54.659461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82afab-aebf-4ec5-8e45-b81c2dae8af0 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:54.659738 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82afab-aebf-4ec5-8e45-b81c2dae8af0 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:54.660008 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82afab-aebf-4ec5-8e45-b81c2dae8af0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:54.661179 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82afab-aebf-4ec5-8e45-b81c2dae8af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:54.662648 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82afab-aebf-4ec5-8e45-b81c2dae8af0 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:54.665011 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 112/222] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:03:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:54.666223 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1f612-2ed8-4947-9e7c-9654a08b0103 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:54.666508 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1f612-2ed8-4947-9e7c-9654a08b0103 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:54.666782 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1f612-2ed8-4947-9e7c-9654a08b0103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:54.685482 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-6ab1f612-2ed8-4947-9e7c-9654a08b0103 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:54.686811 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-6ab1f612-2ed8-4947-9e7c-9654a08b0103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:54.717305 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef096c6f-1143-43c5-b4eb-c631dde31fdb None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:54.753922 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978ff73-1ed7-45fc-b263-c410e2caa8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:54.754607 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978ff73-1ed7-45fc-b263-c410e2caa8cf None admin] REQUEST_METHOD: `PUT` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:54.755031 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978ff73-1ed7-45fc-b263-c410e2caa8cf None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:54.755202 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978ff73-1ed7-45fc-b263-c410e2caa8cf None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0/users/6079fb87a870416daad5f83020ec2431/roles/f2a8452a65264f9ea10467160b1bd735` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:54.757229 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978ff73-1ed7-45fc-b263-c410e2caa8cf None admin] RBAC: Authorizing `identity:create_grant(project_id=638dc1c8e7a34375b96fb45f061210f0, user_id=6079fb87a870416daad5f83020ec2431, role_id=f2a8452a65264f9ea10467160b1bd735)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:54.758000 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 113/223] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:54.758961 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1f612-2ed8-4947-9e7c-9654a08b0103 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:54.766302 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978ff73-1ed7-45fc-b263-c410e2caa8cf None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:54.777335 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:54.780710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 111/224] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Jul 28 11:03:54 2022] PUT /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0/users/6079fb87a870416daad5f83020ec2431/roles/f2a8452a65264f9ea10467160b1bd735 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:03:54.784200 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978ff73-1ed7-45fc-b263-c410e2caa8cf None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:54.841874 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:54.894258 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1f612-2ed8-4947-9e7c-9654a08b0103 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:54.923166 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978ff73-1ed7-45fc-b263-c410e2caa8cf None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:54.939625 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565ed83-3b21-45cb-bdfb-482799772530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:54.940669 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565ed83-3b21-45cb-bdfb-482799772530 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:54.940951 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565ed83-3b21-45cb-bdfb-482799772530 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:54.941222 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565ed83-3b21-45cb-bdfb-482799772530 None admin] PATH_INFO: `/v3/users/d5fdf2e2dd2f4b59bee409ee6ad56548` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:54.956765 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565ed83-3b21-45cb-bdfb-482799772530 None admin] RBAC: Authorizing `identity:get_user(user_id=d5fdf2e2dd2f4b59bee409ee6ad56548)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:54.958261 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565ed83-3b21-45cb-bdfb-482799772530 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:54.960415 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 114/225] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:54 2022] GET /identity/v3/users/d5fdf2e2dd2f4b59bee409ee6ad56548 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:54.961911 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565ed83-3b21-45cb-bdfb-482799772530 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:54.972620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ace21-c466-465a-bf2f-2ce9ec1ed7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:54.973190 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ace21-c466-465a-bf2f-2ce9ec1ed7a1 None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:54.973474 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ace21-c466-465a-bf2f-2ce9ec1ed7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:54.973756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ace21-c466-465a-bf2f-2ce9ec1ed7a1 None admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:54.974461 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ace21-c466-465a-bf2f-2ce9ec1ed7a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:54.975990 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ace21-c466-465a-bf2f-2ce9ec1ed7a1 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:55.000814 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 112/226] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Jul 28 11:03:54 2022] POST /identity/v3/users => generated 297 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:03:55.001673 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ace21-c466-465a-bf2f-2ce9ec1ed7a1 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:55.061051 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:55.100570 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565ed83-3b21-45cb-bdfb-482799772530 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:55.125762 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:55.135745 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ace21-c466-465a-bf2f-2ce9ec1ed7a1 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:55.148951 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29886c40-ee14-4112-816b-3710c8801c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:55.150010 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29886c40-ee14-4112-816b-3710c8801c7f None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:55.150533 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29886c40-ee14-4112-816b-3710c8801c7f None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:55.151069 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29886c40-ee14-4112-816b-3710c8801c7f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:55.164549 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29886c40-ee14-4112-816b-3710c8801c7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:55.170263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-29886c40-ee14-4112-816b-3710c8801c7f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:03:55.170263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:55.170263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:55.170263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:55.170263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:55.170263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:55.170263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:55.170263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:55.170263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:55.170263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:55.170263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:55.170263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:55.170263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:55.170263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:55.170263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:55.170263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:55.171245 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:55.171245 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:55.171245 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:55.171245 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:55.171245 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:55.171245 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:55.171245 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:55.171245 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:55.171245 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:55.171245 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:55.171245 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:55.171245 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:55.171245 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:55.171245 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:55.171245 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:55.171245 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:55.172070 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:55.172070 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:55.172070 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:55.172070 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:55.172070 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:55.172070 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:55.172070 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:55.172070 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:55.172070 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:55.172070 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:55.172070 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:03:55.172070 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:03:55.179595 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 115/227] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:03:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:55.181562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29886c40-ee14-4112-816b-3710c8801c7f None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:55.184775 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554b4ff-9241-4d81-9681-46a430400a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:55.185431 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554b4ff-9241-4d81-9681-46a430400a10 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:55.185761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554b4ff-9241-4d81-9681-46a430400a10 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:55.186041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554b4ff-9241-4d81-9681-46a430400a10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:55.297207 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554b4ff-9241-4d81-9681-46a430400a10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:55.299207 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554b4ff-9241-4d81-9681-46a430400a10 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:55.318819 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29886c40-ee14-4112-816b-3710c8801c7f None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:55.358036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:55.363429 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3028b29-ac30-4061-aac6-80c740afd897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:55.364495 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3028b29-ac30-4061-aac6-80c740afd897 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:55.365005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3028b29-ac30-4061-aac6-80c740afd897 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:55.365565 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3028b29-ac30-4061-aac6-80c740afd897 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:55.366898 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3028b29-ac30-4061-aac6-80c740afd897 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:55.368047 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3028b29-ac30-4061-aac6-80c740afd897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:55.371761 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3028b29-ac30-4061-aac6-80c740afd897 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:55.386628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 116/228] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:03:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:55.395454 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3028b29-ac30-4061-aac6-80c740afd897 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:55.446930 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:55.458433 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 113/229] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:55.465491 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554b4ff-9241-4d81-9681-46a430400a10 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:55.527704 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3028b29-ac30-4061-aac6-80c740afd897 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:55.568903 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c2c48-e1be-4253-b915-d31818c19c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:55.569664 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c2c48-e1be-4253-b915-d31818c19c7c None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:55.569950 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c2c48-e1be-4253-b915-d31818c19c7c None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:55.570266 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c2c48-e1be-4253-b915-d31818c19c7c None admin] PATH_INFO: `/v3/users/6079fb87a870416daad5f83020ec2431` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:55.572052 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c2c48-e1be-4253-b915-d31818c19c7c None admin] RBAC: Authorizing `identity:get_user(user_id=6079fb87a870416daad5f83020ec2431)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:55.573592 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c2c48-e1be-4253-b915-d31818c19c7c None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:55.575381 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 117/230] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:55 2022] GET /identity/v3/users/6079fb87a870416daad5f83020ec2431 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:55.581656 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c2c48-e1be-4253-b915-d31818c19c7c None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:55.587634 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554b4ff-9241-4d81-9681-46a430400a10 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:55.665863 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69f4ff-be6f-4ff1-b6f0-b2058dac257d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:55.666969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69f4ff-be6f-4ff1-b6f0-b2058dac257d None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:55.667505 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69f4ff-be6f-4ff1-b6f0-b2058dac257d None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:55.667996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69f4ff-be6f-4ff1-b6f0-b2058dac257d None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:55.669653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69f4ff-be6f-4ff1-b6f0-b2058dac257d None admin] RBAC: Authorizing `identity:get_project(project_id=638dc1c8e7a34375b96fb45f061210f0)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:55.673206 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69f4ff-be6f-4ff1-b6f0-b2058dac257d None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:55.677612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 114/231] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:55 2022] GET /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:55.691019 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69f4ff-be6f-4ff1-b6f0-b2058dac257d None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:55.726020 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:55.805979 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c2c48-e1be-4253-b915-d31818c19c7c None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:55.811282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:55.884880 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587742f9-18e6-4563-8291-a905fccbb41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:55.885736 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587742f9-18e6-4563-8291-a905fccbb41a None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:55.886021 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587742f9-18e6-4563-8291-a905fccbb41a None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:55.886303 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587742f9-18e6-4563-8291-a905fccbb41a None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:55.888227 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587742f9-18e6-4563-8291-a905fccbb41a None admin] RBAC: Authorizing `identity:get_project(project_id=638dc1c8e7a34375b96fb45f061210f0)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:55.889717 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587742f9-18e6-4563-8291-a905fccbb41a None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:55.891512 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 118/232] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:55 2022] GET /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0 => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:55.897402 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69f4ff-be6f-4ff1-b6f0-b2058dac257d None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:55.902009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587742f9-18e6-4563-8291-a905fccbb41a None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:55.973656 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a861b-7b95-4276-a0c7-ca1e9d66296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:55.974308 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a861b-7b95-4276-a0c7-ca1e9d66296e None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:55.974593 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a861b-7b95-4276-a0c7-ca1e9d66296e None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:55.974878 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a861b-7b95-4276-a0c7-ca1e9d66296e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:55.975793 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a861b-7b95-4276-a0c7-ca1e9d66296e None admin] RBAC: Adding query filter params (role.id=05bb46007d644829b12b0d4ded0bd8d2, scope.project.id=638dc1c8e7a34375b96fb45f061210f0, user.id=d5fdf2e2dd2f4b59bee409ee6ad56548) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:55.976115 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a861b-7b95-4276-a0c7-ca1e9d66296e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:55.978135 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a861b-7b95-4276-a0c7-ca1e9d66296e None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:55.991514 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 115/233] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:03:55 2022] GET /identity/v3/role_assignments?user.id=d5fdf2e2dd2f4b59bee409ee6ad56548&scope.project.id=638dc1c8e7a34375b96fb45f061210f0&role.id=05bb46007d644829b12b0d4ded0bd8d2 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:03:56.052542 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587742f9-18e6-4563-8291-a905fccbb41a None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:56.089892 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:56.098399 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a81852-89f6-4f62-85ec-f0db3297afd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:56.099535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a81852-89f6-4f62-85ec-f0db3297afd2 None admin] REQUEST_METHOD: `PUT` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:56.100044 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a81852-89f6-4f62-85ec-f0db3297afd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:56.100533 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a81852-89f6-4f62-85ec-f0db3297afd2 None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0/users/6079fb87a870416daad5f83020ec2431/roles/e1248e4ba8a34052820e6bd72cdd8b72` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:56.103308 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a81852-89f6-4f62-85ec-f0db3297afd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=638dc1c8e7a34375b96fb45f061210f0, user_id=6079fb87a870416daad5f83020ec2431, role_id=e1248e4ba8a34052820e6bd72cdd8b72)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:56.105122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a81852-89f6-4f62-85ec-f0db3297afd2 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:56.120972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 119/234] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Jul 28 11:03:55 2022] PUT /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0/users/6079fb87a870416daad5f83020ec2431/roles/e1248e4ba8a34052820e6bd72cdd8b72 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:03:57.691598 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9b6dd-ab4e-475b-9087-37774d553fbb None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:57.692102 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9b6dd-ab4e-475b-9087-37774d553fbb None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:57.692102 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9b6dd-ab4e-475b-9087-37774d553fbb None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:57.693695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 116/235] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:57.699588 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f914f-fad6-4e65-95b8-0499126f3c5c None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:57.700092 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f914f-fad6-4e65-95b8-0499126f3c5c None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:57.700354 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f914f-fad6-4e65-95b8-0499126f3c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:57.728072 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-4c3f914f-fad6-4e65-95b8-0499126f3c5c None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:57.729304 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-4c3f914f-fad6-4e65-95b8-0499126f3c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:57.806484 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfc1b6-a559-40c8-a7a6-933009ff197f None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:57.806806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfc1b6-a559-40c8-a7a6-933009ff197f None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:57.807064 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfc1b6-a559-40c8-a7a6-933009ff197f None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:57.808723 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 117/236] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:57.813867 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2d288-6905-4b61-89e3-a51f16922cff None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:57.814384 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2d288-6905-4b61-89e3-a51f16922cff None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:57.814855 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2d288-6905-4b61-89e3-a51f16922cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:57.817842 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 120/237] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:57.852585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-1fd2d288-6905-4b61-89e3-a51f16922cff None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:57.853804 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-1fd2d288-6905-4b61-89e3-a51f16922cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:57.857047 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f914f-fad6-4e65-95b8-0499126f3c5c None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:57.949358 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 118/238] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:57.974463 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2d288-6905-4b61-89e3-a51f16922cff None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:58.039966 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:58.041978 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f914f-fad6-4e65-95b8-0499126f3c5c None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:58.073984 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:58.085313 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7455f-7cb3-43e7-9dd6-6247d40c0806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:58.086788 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7455f-7cb3-43e7-9dd6-6247d40c0806 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:58.087077 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7455f-7cb3-43e7-9dd6-6247d40c0806 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:58.087381 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7455f-7cb3-43e7-9dd6-6247d40c0806 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:58.098488 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7455f-7cb3-43e7-9dd6-6247d40c0806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:58.104122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-7df7455f-7cb3-43e7-9dd6-6247d40c0806 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:03:58.104122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:58.104122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:58.104122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:58.104122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:58.104122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:58.104122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:58.104122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:58.104122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:58.104122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:58.104122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:58.104122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:58.104122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:58.104122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:58.104122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:58.104122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:58.105003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:58.105003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:58.105003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:58.105003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:58.105003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:58.105003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:58.105003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:58.105003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:58.105003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:58.105003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:58.105003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:58.105003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:58.105003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:58.105003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:58.105003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:58.105003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:58.105761 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:58.105761 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:58.105761 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:58.105761 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:58.105761 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:58.105761 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:58.105761 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:58.105761 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:58.105761 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:58.105761 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:58.105761 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:03:58.105761 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:03:58.105761 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 121/239] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Jul 28 11:03:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:03:58.114454 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7455f-7cb3-43e7-9dd6-6247d40c0806 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:58.177718 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2d288-6905-4b61-89e3-a51f16922cff None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:58.233308 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7455f-7cb3-43e7-9dd6-6247d40c0806 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:58.271934 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f60a4-3897-4bd2-9a0a-f10817af9ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:58.272702 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f60a4-3897-4bd2-9a0a-f10817af9ab3 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:58.272991 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f60a4-3897-4bd2-9a0a-f10817af9ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:58.273267 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f60a4-3897-4bd2-9a0a-f10817af9ab3 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:58.274574 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f60a4-3897-4bd2-9a0a-f10817af9ab3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:58.275293 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f60a4-3897-4bd2-9a0a-f10817af9ab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:58.279721 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f60a4-3897-4bd2-9a0a-f10817af9ab3 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:58.286326 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 122/240] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:58.289359 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe5daa-3db4-4796-abec-ce0591047452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:58.290825 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe5daa-3db4-4796-abec-ce0591047452 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:58.291355 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe5daa-3db4-4796-abec-ce0591047452 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:58.291863 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe5daa-3db4-4796-abec-ce0591047452 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:58.292543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f60a4-3897-4bd2-9a0a-f10817af9ab3 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:58.326644 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe5daa-3db4-4796-abec-ce0591047452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:58.332424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-ebfe5daa-3db4-4796-abec-ce0591047452 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 11:03:58.332424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:58.332424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:58.332424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:58.332424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:58.332424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:58.332424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:58.332424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:58.332424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:58.332424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:58.332424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:58.332424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:58.332424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:58.332424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:58.332424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:58.332424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:58.333828 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:58.333828 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:58.333828 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:58.333828 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:58.333828 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:58.333828 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:58.333828 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:58.333828 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:58.333828 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:58.333828 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:58.333828 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:58.333828 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:58.333828 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:58.333828 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:58.333828 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:58.333828 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:58.335030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:58.335030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:58.335030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:58.335030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:58.335030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:58.335030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:58.335030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:58.335030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:58.335030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:58.335030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:58.335030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 11:03:58.335030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:03:58.335030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 119/241] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:03:58.340476 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe5daa-3db4-4796-abec-ce0591047452 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:58.352847 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:58.426236 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f60a4-3897-4bd2-9a0a-f10817af9ab3 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:58.473411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47dde3-afd8-47b4-84e4-a68109d00dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:58.474668 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47dde3-afd8-47b4-84e4-a68109d00dfa None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:58.475136 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47dde3-afd8-47b4-84e4-a68109d00dfa None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:58.475615 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47dde3-afd8-47b4-84e4-a68109d00dfa None admin] PATH_INFO: `/v3/users/6079fb87a870416daad5f83020ec2431` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:58.478163 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47dde3-afd8-47b4-84e4-a68109d00dfa None admin] RBAC: Authorizing `identity:get_user(user_id=6079fb87a870416daad5f83020ec2431)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:58.480419 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47dde3-afd8-47b4-84e4-a68109d00dfa None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:58.483050 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 123/242] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:58 2022] GET /identity/v3/users/6079fb87a870416daad5f83020ec2431 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:03:58.484561 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4800e-e1e1-4388-8049-888d5cb0df9c None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:58.485016 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4800e-e1e1-4388-8049-888d5cb0df9c None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:58.485456 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4800e-e1e1-4388-8049-888d5cb0df9c None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:58.487342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 124/243] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:58.490454 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4800e-e1e1-4388-8049-888d5cb0df9c None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:58.504788 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe5daa-3db4-4796-abec-ce0591047452 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:58.526481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:58.552568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913cb37-99e7-444b-91ad-7ac3c66dbaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:58.553321 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913cb37-99e7-444b-91ad-7ac3c66dbaa6 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:58.553759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913cb37-99e7-444b-91ad-7ac3c66dbaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:58.554103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913cb37-99e7-444b-91ad-7ac3c66dbaa6 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:58.556008 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913cb37-99e7-444b-91ad-7ac3c66dbaa6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:58.556561 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913cb37-99e7-444b-91ad-7ac3c66dbaa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:58.558247 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913cb37-99e7-444b-91ad-7ac3c66dbaa6 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:58.568943 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 120/244] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:03:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:03:58.575948 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8d2ea-8881-41f3-8cbc-829adaa70a2e None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:58.576303 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8d2ea-8881-41f3-8cbc-829adaa70a2e None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:58.576656 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8d2ea-8881-41f3-8cbc-829adaa70a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:58.595300 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-ffc8d2ea-8881-41f3-8cbc-829adaa70a2e None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:58.596642 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-ffc8d2ea-8881-41f3-8cbc-829adaa70a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:58.624890 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4800e-e1e1-4388-8049-888d5cb0df9c None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:58.648846 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:58.675522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b98359-0f14-49c4-9aab-4970dbea1332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:58.676180 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b98359-0f14-49c4-9aab-4970dbea1332 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:58.676461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b98359-0f14-49c4-9aab-4970dbea1332 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:58.676740 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b98359-0f14-49c4-9aab-4970dbea1332 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:58.679154 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 121/245] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:58.681124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8d2ea-8881-41f3-8cbc-829adaa70a2e None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:58.781281 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b98359-0f14-49c4-9aab-4970dbea1332 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:58.782695 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b98359-0f14-49c4-9aab-4970dbea1332 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:58.790473 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8d2ea-8881-41f3-8cbc-829adaa70a2e None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:58.800882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:58.828814 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab96dd-738d-4899-b1ad-fd24a5912f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:58.829556 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab96dd-738d-4899-b1ad-fd24a5912f45 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:58.829843 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab96dd-738d-4899-b1ad-fd24a5912f45 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:58.830120 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab96dd-738d-4899-b1ad-fd24a5912f45 None admin] PATH_INFO: `/v3/users/0345f23f1ef4428580f34e94d78e06d2` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:58.847004 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab96dd-738d-4899-b1ad-fd24a5912f45 None admin] RBAC: Authorizing `identity:get_user(user_id=0345f23f1ef4428580f34e94d78e06d2)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:58.848622 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab96dd-738d-4899-b1ad-fd24a5912f45 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:58.850413 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 122/246] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:03:58 2022] GET /identity/v3/users/0345f23f1ef4428580f34e94d78e06d2 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:58.852565 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab96dd-738d-4899-b1ad-fd24a5912f45 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:58.900935 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 125/247] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:03:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:58.902358 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89643b2c-8204-414f-b637-88f9c844dd63 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:58.902726 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89643b2c-8204-414f-b637-88f9c844dd63 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:58.903080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89643b2c-8204-414f-b637-88f9c844dd63 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:58.904788 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 126/248] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:58.905614 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89643b2c-8204-414f-b637-88f9c844dd63 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:58.924785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:58.986730 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab96dd-738d-4899-b1ad-fd24a5912f45 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:59.025478 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e501b8-cfa2-4418-aa87-5af1af16d497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:59.026159 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e501b8-cfa2-4418-aa87-5af1af16d497 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:59.026502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e501b8-cfa2-4418-aa87-5af1af16d497 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:59.026790 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e501b8-cfa2-4418-aa87-5af1af16d497 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:59.028012 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e501b8-cfa2-4418-aa87-5af1af16d497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:59.029481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e501b8-cfa2-4418-aa87-5af1af16d497 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:59.029600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89643b2c-8204-414f-b637-88f9c844dd63 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:59.031423 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 123/249] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:03:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:59.036526 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e501b8-cfa2-4418-aa87-5af1af16d497 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:59.071546 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce3588-021e-43d6-bf34-57103b3e0932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:59.072225 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce3588-021e-43d6-bf34-57103b3e0932 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:59.072511 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce3588-021e-43d6-bf34-57103b3e0932 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:59.072781 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce3588-021e-43d6-bf34-57103b3e0932 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:59.078170 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:59.157660 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce3588-021e-43d6-bf34-57103b3e0932 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:59.159227 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce3588-021e-43d6-bf34-57103b3e0932 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:59.162675 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e501b8-cfa2-4418-aa87-5af1af16d497 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:59.174075 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:59.203694 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a307567-4bdc-4527-a27d-3606e401e2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:59.204446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a307567-4bdc-4527-a27d-3606e401e2a6 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:59.204637 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a307567-4bdc-4527-a27d-3606e401e2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:59.204911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a307567-4bdc-4527-a27d-3606e401e2a6 None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:59.206116 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a307567-4bdc-4527-a27d-3606e401e2a6 None admin] RBAC: Authorizing `identity:get_project(project_id=638dc1c8e7a34375b96fb45f061210f0)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:59.207658 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a307567-4bdc-4527-a27d-3606e401e2a6 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:59.209379 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 124/250] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:59 2022] GET /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:59.210527 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d7015-3b56-4e90-82e6-f5d3fe51d665 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:59.210817 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d7015-3b56-4e90-82e6-f5d3fe51d665 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:59.211092 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d7015-3b56-4e90-82e6-f5d3fe51d665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:59.230684 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-567d7015-3b56-4e90-82e6-f5d3fe51d665 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:59.231930 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-567d7015-3b56-4e90-82e6-f5d3fe51d665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:59.278508 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 127/251] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:03:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:03:59.283513 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce3588-021e-43d6-bf34-57103b3e0932 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:59.308695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 125/252] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:59.309553 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d7015-3b56-4e90-82e6-f5d3fe51d665 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:59.349358 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:59.396635 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce3588-021e-43d6-bf34-57103b3e0932 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:59.408677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:59.426107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d7015-3b56-4e90-82e6-f5d3fe51d665 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:59.434257 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15deb94b-3301-4af4-bb89-0f23418a94a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:59.434898 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15deb94b-3301-4af4-bb89-0f23418a94a8 None admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:59.435181 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15deb94b-3301-4af4-bb89-0f23418a94a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:59.435489 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15deb94b-3301-4af4-bb89-0f23418a94a8 None admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:59.436189 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15deb94b-3301-4af4-bb89-0f23418a94a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:59.437676 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15deb94b-3301-4af4-bb89-0f23418a94a8 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:59.460468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 128/253] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Jul 28 11:03:59 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:03:59.466460 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15deb94b-3301-4af4-bb89-0f23418a94a8 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:59.466673 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30121233-6d51-4074-8097-cca94a2a3a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:59.467287 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30121233-6d51-4074-8097-cca94a2a3a22 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:59.467596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30121233-6d51-4074-8097-cca94a2a3a22 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:59.467925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30121233-6d51-4074-8097-cca94a2a3a22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:59.468750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30121233-6d51-4074-8097-cca94a2a3a22 None admin] RBAC: Adding query filter params (role.id=f2a8452a65264f9ea10467160b1bd735, scope.project.id=638dc1c8e7a34375b96fb45f061210f0, user.id=6079fb87a870416daad5f83020ec2431) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:59.469111 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30121233-6d51-4074-8097-cca94a2a3a22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:59.471522 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30121233-6d51-4074-8097-cca94a2a3a22 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:59.478203 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 126/254] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:03:59 2022] GET /identity/v3/role_assignments?user.id=6079fb87a870416daad5f83020ec2431&scope.project.id=638dc1c8e7a34375b96fb45f061210f0&role.id=f2a8452a65264f9ea10467160b1bd735 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:59.489962 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab332-dcb4-4f73-8c3a-58a2ce1a5188 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:59.490577 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab332-dcb4-4f73-8c3a-58a2ce1a5188 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:59.491056 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab332-dcb4-4f73-8c3a-58a2ce1a5188 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:59.499637 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 127/255] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:03:59 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:03:59.500529 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bab332-dcb4-4f73-8c3a-58a2ce1a5188 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:59.634075 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15deb94b-3301-4af4-bb89-0f23418a94a8 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:59.673799 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:59.684264 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34121b52-671a-495a-8179-0cbce65f5ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:59.684264 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34121b52-671a-495a-8179-0cbce65f5ae4 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:59.684264 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34121b52-671a-495a-8179-0cbce65f5ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:59.684264 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34121b52-671a-495a-8179-0cbce65f5ae4 None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:59.686314 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34121b52-671a-495a-8179-0cbce65f5ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=638dc1c8e7a34375b96fb45f061210f0)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:59.687548 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bab332-dcb4-4f73-8c3a-58a2ce1a5188 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:59.687846 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34121b52-671a-495a-8179-0cbce65f5ae4 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:59.689768 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 129/256] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:03:59 2022] GET /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:59.690936 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a7091-c691-4f23-9ec7-a1a8e3623cb6 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:59.691220 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a7091-c691-4f23-9ec7-a1a8e3623cb6 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:59.691617 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a7091-c691-4f23-9ec7-a1a8e3623cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:59.712202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-a06a7091-c691-4f23-9ec7-a1a8e3623cb6 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:03:59.713428 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-a06a7091-c691-4f23-9ec7-a1a8e3623cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:03:59.743245 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e66fe-d504-4126-86ee-3aaf78411a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:59.743492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e66fe-d504-4126-86ee-3aaf78411a3f None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:59.743845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e66fe-d504-4126-86ee-3aaf78411a3f None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:59.743946 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e66fe-d504-4126-86ee-3aaf78411a3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:59.748970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:03:59.764806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e66fe-d504-4126-86ee-3aaf78411a3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:03:59.771812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-d08e66fe-d504-4126-86ee-3aaf78411a3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:03:59.771812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:03:59.771812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:03:59.771812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:03:59.771812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:03:59.771812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:03:59.771812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:03:59.771812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:03:59.771812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:03:59.771812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:03:59.771812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:03:59.771812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:03:59.771812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:03:59.771812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:03:59.771812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:03:59.771812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:03:59.772724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:03:59.772724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:03:59.772724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:03:59.772724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:03:59.772724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:03:59.772724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:03:59.772724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:03:59.772724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:03:59.772724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:03:59.772724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:03:59.772724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:03:59.772724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:03:59.772724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:03:59.772724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:03:59.772724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:03:59.772724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:03:59.774113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:03:59.774113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:03:59.774113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:03:59.774113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:03:59.774113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:03:59.774113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:03:59.774113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:03:59.774113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:03:59.774113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:03:59.774113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:03:59.774113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:03:59.774113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:03:59.774113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 128/257] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:03:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:03:59.774751 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e66fe-d504-4126-86ee-3aaf78411a3f None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:59.809354 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 130/258] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:03:59.810292 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a7091-c691-4f23-9ec7-a1a8e3623cb6 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:03:59.906840 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e66fe-d504-4126-86ee-3aaf78411a3f None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:59.945847 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a7091-c691-4f23-9ec7-a1a8e3623cb6 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:03:59.960178 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b4ac5-ab3d-4284-847f-593280f878b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:03:59.961658 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b4ac5-ab3d-4284-847f-593280f878b6 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:03:59.962465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b4ac5-ab3d-4284-847f-593280f878b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:03:59.962757 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b4ac5-ab3d-4284-847f-593280f878b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:03:59.963892 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b4ac5-ab3d-4284-847f-593280f878b6 None admin] RBAC: Adding query filter params (role.id=c29fdaefa55648b582d687cc5541fb3e, scope.project.id=638dc1c8e7a34375b96fb45f061210f0, user.id=0345f23f1ef4428580f34e94d78e06d2) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:03:59.964211 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b4ac5-ab3d-4284-847f-593280f878b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:03:59.966415 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b4ac5-ab3d-4284-847f-593280f878b6 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:03:59.974800 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 129/259] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:03:59 2022] GET /identity/v3/role_assignments?user.id=0345f23f1ef4428580f34e94d78e06d2&scope.project.id=638dc1c8e7a34375b96fb45f061210f0&role.id=c29fdaefa55648b582d687cc5541fb3e => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:03:59.975683 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b4ac5-ab3d-4284-847f-593280f878b6 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:00.008261 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:00.009152 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c024ac-dbf3-47b6-a08c-168458cd0d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:00.009944 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c024ac-dbf3-47b6-a08c-168458cd0d38 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:00.010585 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c024ac-dbf3-47b6-a08c-168458cd0d38 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:00.010896 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c024ac-dbf3-47b6-a08c-168458cd0d38 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:00.011658 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c024ac-dbf3-47b6-a08c-168458cd0d38 None admin] RBAC: Adding query filter params (name=member) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:00.011962 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c024ac-dbf3-47b6-a08c-168458cd0d38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:00.013478 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c024ac-dbf3-47b6-a08c-168458cd0d38 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:00.035300 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 131/260] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:03:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:00.041037 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c024ac-dbf3-47b6-a08c-168458cd0d38 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:00.109206 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:00.117891 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b4ac5-ab3d-4284-847f-593280f878b6 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:00.163456 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e8893-bc68-463f-9a23-4cea7065a0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:00.164087 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e8893-bc68-463f-9a23-4cea7065a0ac None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:00.165090 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e8893-bc68-463f-9a23-4cea7065a0ac None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:00.165390 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e8893-bc68-463f-9a23-4cea7065a0ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:00.182171 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e8893-bc68-463f-9a23-4cea7065a0ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:00.190248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-ae2e8893-bc68-463f-9a23-4cea7065a0ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:04:00.190248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:00.190248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:00.190248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:00.190248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:00.190248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:00.190248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:00.190248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:00.190248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:00.190248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:00.190248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:00.190248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:00.190248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:00.190248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:00.190248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:00.190248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:00.191306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:00.191306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:00.191306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:00.191306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:00.191306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:00.191306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:00.191306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:00.191306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:00.191306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:00.191306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:00.191306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:00.191306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:00.191306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:00.191306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:00.191306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:00.191306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:00.192338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:00.192338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:00.192338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:00.192338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:00.192338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:00.192338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:00.192338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:00.192338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:00.192338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:00.192338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:00.192338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:04:00.192338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:00.192338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 130/261] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:03:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:00.201738 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e8893-bc68-463f-9a23-4cea7065a0ac None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:00.251835 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c024ac-dbf3-47b6-a08c-168458cd0d38 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:00.318857 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0df688-2e27-4564-8e1c-20b0525dff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:00.324078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0df688-2e27-4564-8e1c-20b0525dff6a None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:00.324371 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0df688-2e27-4564-8e1c-20b0525dff6a None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:00.324658 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0df688-2e27-4564-8e1c-20b0525dff6a None admin] PATH_INFO: `/v3/users/d5fdf2e2dd2f4b59bee409ee6ad56548` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:00.326636 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0df688-2e27-4564-8e1c-20b0525dff6a None admin] RBAC: Authorizing `identity:get_user(user_id=d5fdf2e2dd2f4b59bee409ee6ad56548)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:00.328161 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0df688-2e27-4564-8e1c-20b0525dff6a None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:00.330059 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 132/262] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:04:00 2022] GET /identity/v3/users/d5fdf2e2dd2f4b59bee409ee6ad56548 => generated 297 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:00.336667 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0df688-2e27-4564-8e1c-20b0525dff6a None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:00.363696 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:00.404709 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e8893-bc68-463f-9a23-4cea7065a0ac None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:00.451562 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824bdbf-31d2-48c7-b2d6-14ef4f7596da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:00.452116 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824bdbf-31d2-48c7-b2d6-14ef4f7596da None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:00.452400 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824bdbf-31d2-48c7-b2d6-14ef4f7596da None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:00.452678 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824bdbf-31d2-48c7-b2d6-14ef4f7596da None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:00.453400 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824bdbf-31d2-48c7-b2d6-14ef4f7596da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:00.453706 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824bdbf-31d2-48c7-b2d6-14ef4f7596da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:00.455128 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824bdbf-31d2-48c7-b2d6-14ef4f7596da None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:00.464830 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 131/263] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:00.470384 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824bdbf-31d2-48c7-b2d6-14ef4f7596da None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:00.471054 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:00.489803 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0df688-2e27-4564-8e1c-20b0525dff6a None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:00.560790 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c83d7c-7519-4126-a1a5-3c1cb2652ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:00.561526 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c83d7c-7519-4126-a1a5-3c1cb2652ed9 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:00.561815 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c83d7c-7519-4126-a1a5-3c1cb2652ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:00.562101 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c83d7c-7519-4126-a1a5-3c1cb2652ed9 None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:00.563442 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c83d7c-7519-4126-a1a5-3c1cb2652ed9 None admin] RBAC: Authorizing `identity:get_project(project_id=638dc1c8e7a34375b96fb45f061210f0)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:00.565119 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c83d7c-7519-4126-a1a5-3c1cb2652ed9 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:00.567217 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 133/264] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:00 2022] GET /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:00.576346 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c83d7c-7519-4126-a1a5-3c1cb2652ed9 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:00.585471 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824bdbf-31d2-48c7-b2d6-14ef4f7596da None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:00.629576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20fa89-2079-4f08-b6d6-02755f4f3c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:00.630237 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20fa89-2079-4f08-b6d6-02755f4f3c5f None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:00.630525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20fa89-2079-4f08-b6d6-02755f4f3c5f None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:00.630799 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20fa89-2079-4f08-b6d6-02755f4f3c5f None admin] PATH_INFO: `/v3/users/6079fb87a870416daad5f83020ec2431` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:00.632005 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20fa89-2079-4f08-b6d6-02755f4f3c5f None admin] RBAC: Authorizing `identity:get_user(user_id=6079fb87a870416daad5f83020ec2431)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:00.633510 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20fa89-2079-4f08-b6d6-02755f4f3c5f None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:00.639989 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 132/265] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:04:00 2022] GET /identity/v3/users/6079fb87a870416daad5f83020ec2431 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:00.640908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20fa89-2079-4f08-b6d6-02755f4f3c5f None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:00.654219 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:00.751890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20fa89-2079-4f08-b6d6-02755f4f3c5f None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:00.793068 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32152234-5730-46c1-865a-f8d184d7a240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:00.793711 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32152234-5730-46c1-865a-f8d184d7a240 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:00.793998 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32152234-5730-46c1-865a-f8d184d7a240 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:00.794276 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32152234-5730-46c1-865a-f8d184d7a240 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:00.878118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32152234-5730-46c1-865a-f8d184d7a240 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:00.878118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32152234-5730-46c1-865a-f8d184d7a240 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:00.891430 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:00.972896 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c83d7c-7519-4126-a1a5-3c1cb2652ed9 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:01.011737 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 133/266] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:01.025142 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32152234-5730-46c1-865a-f8d184d7a240 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:01.041907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cfa29-b97a-4963-bbd5-d70b0fd6865a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:01.042841 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cfa29-b97a-4963-bbd5-d70b0fd6865a None admin] REQUEST_METHOD: `PUT` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:01.043125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cfa29-b97a-4963-bbd5-d70b0fd6865a None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:01.043428 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cfa29-b97a-4963-bbd5-d70b0fd6865a None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0/users/d5fdf2e2dd2f4b59bee409ee6ad56548/roles/05bb46007d644829b12b0d4ded0bd8d2` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:01.049470 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2cfa29-b97a-4963-bbd5-d70b0fd6865a None admin] RBAC: Authorizing `identity:create_grant(project_id=638dc1c8e7a34375b96fb45f061210f0, user_id=d5fdf2e2dd2f4b59bee409ee6ad56548, role_id=05bb46007d644829b12b0d4ded0bd8d2)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:01.050971 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2cfa29-b97a-4963-bbd5-d70b0fd6865a None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:01.072484 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 134/267] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Jul 28 11:04:00 2022] PUT /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0/users/d5fdf2e2dd2f4b59bee409ee6ad56548/roles/05bb46007d644829b12b0d4ded0bd8d2 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:04:01.238607 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32152234-5730-46c1-865a-f8d184d7a240 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:01.261442 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:01.302066 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6182cac-7177-4cd5-9677-a60e81151e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:01.302677 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6182cac-7177-4cd5-9677-a60e81151e11 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:01.302973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6182cac-7177-4cd5-9677-a60e81151e11 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:01.303254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6182cac-7177-4cd5-9677-a60e81151e11 None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:01.310156 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6182cac-7177-4cd5-9677-a60e81151e11 None admin] RBAC: Authorizing `identity:get_project(project_id=638dc1c8e7a34375b96fb45f061210f0)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:01.311698 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6182cac-7177-4cd5-9677-a60e81151e11 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:01.313836 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 134/268] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:01 2022] GET /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:01.320027 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cfa29-b97a-4963-bbd5-d70b0fd6865a None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:01.360742 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:01.474312 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cfa29-b97a-4963-bbd5-d70b0fd6865a None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:01.528081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2bbb0-5749-411d-ad49-c78895b2be57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:01.528993 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2bbb0-5749-411d-ad49-c78895b2be57 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:01.529537 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2bbb0-5749-411d-ad49-c78895b2be57 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:01.530050 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2bbb0-5749-411d-ad49-c78895b2be57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:01.531053 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2bbb0-5749-411d-ad49-c78895b2be57 None admin] RBAC: Adding query filter params (role.id=e1248e4ba8a34052820e6bd72cdd8b72, scope.project.id=638dc1c8e7a34375b96fb45f061210f0, user.id=6079fb87a870416daad5f83020ec2431) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:01.531548 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2bbb0-5749-411d-ad49-c78895b2be57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:01.533549 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2bbb0-5749-411d-ad49-c78895b2be57 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:01.541765 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 135/269] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:04:01 2022] GET /identity/v3/role_assignments?user.id=6079fb87a870416daad5f83020ec2431&scope.project.id=638dc1c8e7a34375b96fb45f061210f0&role.id=e1248e4ba8a34052820e6bd72cdd8b72 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:02.436331 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea33270-a0d4-4840-8d3e-5a9d275acd36 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:02.436843 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea33270-a0d4-4840-8d3e-5a9d275acd36 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:02.436925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea33270-a0d4-4840-8d3e-5a9d275acd36 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:02.438529 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 135/270] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:02.444437 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a168a-8c52-45a2-9c7d-c67ceb382059 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:02.444914 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a168a-8c52-45a2-9c7d-c67ceb382059 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:02.445922 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a168a-8c52-45a2-9c7d-c67ceb382059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:02.466109 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-a28a168a-8c52-45a2-9c7d-c67ceb382059 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:02.468517 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c55b1f-33a2-4d98-b539-45b6d3050b78 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:02.468803 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c55b1f-33a2-4d98-b539-45b6d3050b78 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:02.469081 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c55b1f-33a2-4d98-b539-45b6d3050b78 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:02.469706 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-a28a168a-8c52-45a2-9c7d-c67ceb382059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:02.470700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 136/271] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:04:02.476737 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07442d24-0073-4945-9387-d6ef4855a2b7 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:02.477156 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07442d24-0073-4945-9387-d6ef4855a2b7 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:02.477646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07442d24-0073-4945-9387-d6ef4855a2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:02.497067 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-07442d24-0073-4945-9387-d6ef4855a2b7 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:02.498715 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-07442d24-0073-4945-9387-d6ef4855a2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:02.551318 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 136/272] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:02.572576 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a168a-8c52-45a2-9c7d-c67ceb382059 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:02.587319 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 137/273] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:02.597291 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:02.613998 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07442d24-0073-4945-9387-d6ef4855a2b7 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:02.704949 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a168a-8c52-45a2-9c7d-c67ceb382059 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:02.749058 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07442d24-0073-4945-9387-d6ef4855a2b7 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:02.757138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4543a-5fe3-41df-9ea2-22b0d37b7e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:02.758500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4543a-5fe3-41df-9ea2-22b0d37b7e12 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:02.758878 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4543a-5fe3-41df-9ea2-22b0d37b7e12 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:02.759251 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4543a-5fe3-41df-9ea2-22b0d37b7e12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:02.763985 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:02.773962 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4543a-5fe3-41df-9ea2-22b0d37b7e12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:02.780578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-04b4543a-5fe3-41df-9ea2-22b0d37b7e12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:02.780578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:02.780578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:02.780578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:02.780578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:02.780578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:02.780578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:02.780578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:02.780578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:02.780578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:02.780578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:02.780578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:02.780578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:02.780578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:02.780578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:02.780578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:02.781486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:02.781486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:02.781486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:02.781486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:02.781486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:02.781486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:02.781486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:02.781486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:02.781486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:02.781486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:02.781486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:02.781486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:02.781486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:02.781486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:02.781486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:02.781486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:02.782259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:02.782259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:02.782259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:02.782259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:02.782259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:02.782259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:02.782259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:02.782259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:02.782259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:02.782259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:02.782259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:02.782259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:02.787351 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 137/274] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:04:02.789613 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4543a-5fe3-41df-9ea2-22b0d37b7e12 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:02.801153 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb497d-eff0-4370-b556-81239560cc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:02.802517 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb497d-eff0-4370-b556-81239560cc0b None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:02.803001 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb497d-eff0-4370-b556-81239560cc0b None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:02.803502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb497d-eff0-4370-b556-81239560cc0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:02.805294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb497d-eff0-4370-b556-81239560cc0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:02.807550 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb497d-eff0-4370-b556-81239560cc0b None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:02.814313 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 138/275] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:02.815390 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb497d-eff0-4370-b556-81239560cc0b None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:02.900476 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:02.926428 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4543a-5fe3-41df-9ea2-22b0d37b7e12 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:02.938429 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb497d-eff0-4370-b556-81239560cc0b None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:02.963600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c2fd0-fb94-4a04-9979-38579bd5d11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:02.964168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2fd0-fb94-4a04-9979-38579bd5d11a None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:02.964418 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2fd0-fb94-4a04-9979-38579bd5d11a None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:02.964670 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2fd0-fb94-4a04-9979-38579bd5d11a None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:02.965410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c2fd0-fb94-4a04-9979-38579bd5d11a None admin] RBAC: Adding query filter params (name=member) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:02.965710 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c2fd0-fb94-4a04-9979-38579bd5d11a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:02.968064 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c2fd0-fb94-4a04-9979-38579bd5d11a None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:02.976614 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 138/276] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:04:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:02.979720 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b8f91-8c29-4f1a-bc83-6924940c187e None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:02.980017 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b8f91-8c29-4f1a-bc83-6924940c187e None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:02.980306 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b8f91-8c29-4f1a-bc83-6924940c187e None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:02.982816 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a360b8-464a-4ff5-8bde-02765038edd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:02.983492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a360b8-464a-4ff5-8bde-02765038edd2 None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:02.983783 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a360b8-464a-4ff5-8bde-02765038edd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:02.984065 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a360b8-464a-4ff5-8bde-02765038edd2 None admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:02.984754 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a360b8-464a-4ff5-8bde-02765038edd2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:02.985782 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 139/277] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:02.986592 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b8f91-8c29-4f1a-bc83-6924940c187e None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:02.986704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a360b8-464a-4ff5-8bde-02765038edd2 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:03.015306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 139/278] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Jul 28 11:04:02 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:04:03.015306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88134b03-6d72-4860-88e7-bac635d0a892 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:03.015306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88134b03-6d72-4860-88e7-bac635d0a892 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:03.015306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88134b03-6d72-4860-88e7-bac635d0a892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:03.030469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-88134b03-6d72-4860-88e7-bac635d0a892 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:03.031856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-88134b03-6d72-4860-88e7-bac635d0a892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:03.064444 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:03.116817 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 140/279] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:03.142933 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88134b03-6d72-4860-88e7-bac635d0a892 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:03.143374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b8f91-8c29-4f1a-bc83-6924940c187e None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:03.192501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91946f-a547-4f49-bec3-e08d4c422457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:03.193209 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91946f-a547-4f49-bec3-e08d4c422457 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:03.193497 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91946f-a547-4f49-bec3-e08d4c422457 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:03.193885 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91946f-a547-4f49-bec3-e08d4c422457 None admin] PATH_INFO: `/v3/users/cfc26a0d35fb41cc9cd76088ad77a483` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:03.206867 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:03.216013 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91946f-a547-4f49-bec3-e08d4c422457 None admin] RBAC: Authorizing `identity:get_user(user_id=cfc26a0d35fb41cc9cd76088ad77a483)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:03.218318 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91946f-a547-4f49-bec3-e08d4c422457 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:03.220576 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 140/280] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:04:02 2022] GET /identity/v3/users/cfc26a0d35fb41cc9cd76088ad77a483 => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:03.226711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91946f-a547-4f49-bec3-e08d4c422457 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:03.284487 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88134b03-6d72-4860-88e7-bac635d0a892 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:03.327044 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f97f66-faa2-478a-9100-f082b02f7fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:03.327755 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f97f66-faa2-478a-9100-f082b02f7fa4 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:03.328023 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f97f66-faa2-478a-9100-f082b02f7fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:03.328304 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f97f66-faa2-478a-9100-f082b02f7fa4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:03.341920 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f97f66-faa2-478a-9100-f082b02f7fa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:03.347163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-42f97f66-faa2-478a-9100-f082b02f7fa4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 11:04:03.347163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:03.347163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:03.347163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:03.347163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:03.347163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:03.347163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:03.347163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:03.347163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:03.347163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:03.347163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:03.347163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:03.347163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:03.347163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:03.347163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:03.347163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:03.348434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:03.348434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:03.348434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:03.348434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:03.348434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:03.348434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:03.348434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:03.348434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:03.348434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:03.348434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:03.348434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:03.348434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:03.348434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:03.348434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:03.348434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:03.348434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:03.349586 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:03.349586 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:03.349586 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:03.349586 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:03.349586 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:03.349586 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:03.349586 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:03.349586 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:03.349586 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:03.349586 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:03.349586 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 11:04:03.349586 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:03.349586 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 141/281] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:03.354323 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f97f66-faa2-478a-9100-f082b02f7fa4 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:03.372619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91946f-a547-4f49-bec3-e08d4c422457 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:03.387522 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:03.426028 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10b7f5-0c0f-4a53-8bb6-cf08288d8523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:03.427063 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10b7f5-0c0f-4a53-8bb6-cf08288d8523 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:03.427487 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10b7f5-0c0f-4a53-8bb6-cf08288d8523 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:03.427839 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10b7f5-0c0f-4a53-8bb6-cf08288d8523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:03.428711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10b7f5-0c0f-4a53-8bb6-cf08288d8523 None admin] RBAC: Adding query filter params (role.id=05bb46007d644829b12b0d4ded0bd8d2, user.id=cfc26a0d35fb41cc9cd76088ad77a483, scope.system=all) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:03.429097 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10b7f5-0c0f-4a53-8bb6-cf08288d8523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:03.430967 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10b7f5-0c0f-4a53-8bb6-cf08288d8523 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:03.437637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 141/282] 10.222.0.71 () {56 vars in 1308 bytes} [Thu Jul 28 11:04:03 2022] GET /identity/v3/role_assignments?user.id=cfc26a0d35fb41cc9cd76088ad77a483&scope.system=all&role.id=05bb46007d644829b12b0d4ded0bd8d2 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:03.495144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f97f66-faa2-478a-9100-f082b02f7fa4 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:03.547436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2171d3-1e8d-402b-956f-46745451a6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:03.548105 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2171d3-1e8d-402b-956f-46745451a6a4 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:03.548395 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2171d3-1e8d-402b-956f-46745451a6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:03.548673 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2171d3-1e8d-402b-956f-46745451a6a4 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:03.549439 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2171d3-1e8d-402b-956f-46745451a6a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:03.549752 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2171d3-1e8d-402b-956f-46745451a6a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:03.551224 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2171d3-1e8d-402b-956f-46745451a6a4 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:03.565922 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 142/283] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:04:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:03.575012 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10b7f5-0c0f-4a53-8bb6-cf08288d8523 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:03.693763 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dd7fc-e8c3-4c97-aafd-e7279dcc7149 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:03.694323 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dd7fc-e8c3-4c97-aafd-e7279dcc7149 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:03.694816 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dd7fc-e8c3-4c97-aafd-e7279dcc7149 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:03.697456 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 143/284] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:03.698832 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:03.704578 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5da53f-e486-41dd-9f8b-eda1452e82a4 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:03.704903 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5da53f-e486-41dd-9f8b-eda1452e82a4 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:03.705144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5da53f-e486-41dd-9f8b-eda1452e82a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:03.738984 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-4c5da53f-e486-41dd-9f8b-eda1452e82a4 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:03.740228 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-4c5da53f-e486-41dd-9f8b-eda1452e82a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:03.792675 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10b7f5-0c0f-4a53-8bb6-cf08288d8523 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:03.859842 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f65d7-1ede-4267-bc26-5dcd488d1ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:03.860502 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f65d7-1ede-4267-bc26-5dcd488d1ed5 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:03.860787 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f65d7-1ede-4267-bc26-5dcd488d1ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:03.861068 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f65d7-1ede-4267-bc26-5dcd488d1ed5 None admin] PATH_INFO: `/v3/users/0345f23f1ef4428580f34e94d78e06d2` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:03.862858 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f65d7-1ede-4267-bc26-5dcd488d1ed5 None admin] RBAC: Authorizing `identity:get_user(user_id=0345f23f1ef4428580f34e94d78e06d2)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:03.868793 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f65d7-1ede-4267-bc26-5dcd488d1ed5 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:03.870567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 142/285] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:04:03 2022] GET /identity/v3/users/0345f23f1ef4428580f34e94d78e06d2 => generated 297 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:03.876776 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f65d7-1ede-4267-bc26-5dcd488d1ed5 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:03.879491 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 144/286] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:04:03.948482 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5da53f-e486-41dd-9f8b-eda1452e82a4 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:03.971238 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:04.059522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f65d7-1ede-4267-bc26-5dcd488d1ed5 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:04.092930 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:04.104107 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17114985-5fea-4ba8-a3b3-0658d9f91361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:04.105397 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17114985-5fea-4ba8-a3b3-0658d9f91361 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:04.105887 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17114985-5fea-4ba8-a3b3-0658d9f91361 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:04.106751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17114985-5fea-4ba8-a3b3-0658d9f91361 None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:04.108304 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17114985-5fea-4ba8-a3b3-0658d9f91361 None admin] RBAC: Authorizing `identity:get_project(project_id=638dc1c8e7a34375b96fb45f061210f0)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:04.109984 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17114985-5fea-4ba8-a3b3-0658d9f91361 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:04.111957 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 143/287] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:03 2022] GET /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:04.119733 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17114985-5fea-4ba8-a3b3-0658d9f91361 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:04.143885 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5da53f-e486-41dd-9f8b-eda1452e82a4 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:04.184337 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af533e99-2527-43d4-986f-e6523e276274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:04.185406 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af533e99-2527-43d4-986f-e6523e276274 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:04.186978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af533e99-2527-43d4-986f-e6523e276274 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:04.188153 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af533e99-2527-43d4-986f-e6523e276274 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:04.211302 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af533e99-2527-43d4-986f-e6523e276274 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:04.217887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-af533e99-2527-43d4-986f-e6523e276274 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:04.217887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:04.217887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:04.217887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:04.217887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:04.217887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:04.217887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:04.217887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:04.217887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:04.217887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:04.217887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:04.217887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:04.217887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:04.217887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:04.217887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:04.217887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:04.218974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:04.218974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:04.218974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:04.218974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:04.218974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:04.218974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:04.218974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:04.218974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:04.218974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:04.218974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:04.218974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:04.218974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:04.218974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:04.218974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:04.218974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:04.218974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:04.220009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:04.220009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:04.220009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:04.220009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:04.220009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:04.220009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:04.220009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:04.220009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:04.220009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:04.220009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:04.220009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:04.220009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:04.224593 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 145/288] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:04:04.231204 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af533e99-2527-43d4-986f-e6523e276274 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:04.331701 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17114985-5fea-4ba8-a3b3-0658d9f91361 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:04.380508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:04.407341 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e35f0-d47f-4a35-a6c0-c781941ea6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:04.408218 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e35f0-d47f-4a35-a6c0-c781941ea6f8 None admin] REQUEST_METHOD: `PUT` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:04.408514 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e35f0-d47f-4a35-a6c0-c781941ea6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:04.408797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e35f0-d47f-4a35-a6c0-c781941ea6f8 None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0/users/0345f23f1ef4428580f34e94d78e06d2/roles/c29fdaefa55648b582d687cc5541fb3e` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:04.411971 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e35f0-d47f-4a35-a6c0-c781941ea6f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=638dc1c8e7a34375b96fb45f061210f0, user_id=0345f23f1ef4428580f34e94d78e06d2, role_id=c29fdaefa55648b582d687cc5541fb3e)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:04.413452 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e35f0-d47f-4a35-a6c0-c781941ea6f8 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:04.432094 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af533e99-2527-43d4-986f-e6523e276274 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:04.436402 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 144/289] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Jul 28 11:04:04 2022] PUT /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0/users/0345f23f1ef4428580f34e94d78e06d2/roles/c29fdaefa55648b582d687cc5541fb3e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:04:04.489743 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3142e-1172-437a-9f50-7bc72b3a7edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:04.490392 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3142e-1172-437a-9f50-7bc72b3a7edd None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:04.490678 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3142e-1172-437a-9f50-7bc72b3a7edd None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:04.490960 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3142e-1172-437a-9f50-7bc72b3a7edd None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:04.491722 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3142e-1172-437a-9f50-7bc72b3a7edd None admin] RBAC: Adding query filter params (name=member) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:04.492089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3142e-1172-437a-9f50-7bc72b3a7edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:04.494006 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3142e-1172-437a-9f50-7bc72b3a7edd None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:04.507805 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 146/290] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:04:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:04.514032 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e35f0-d47f-4a35-a6c0-c781941ea6f8 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:04.583547 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:04.646530 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e35f0-d47f-4a35-a6c0-c781941ea6f8 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:04.691222 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e8505-5847-4b17-884f-dbdc3151761e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:04.691936 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e8505-5847-4b17-884f-dbdc3151761e None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:04.692221 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e8505-5847-4b17-884f-dbdc3151761e None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:04.692502 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e8505-5847-4b17-884f-dbdc3151761e None admin] PATH_INFO: `/v3/users/d5fdf2e2dd2f4b59bee409ee6ad56548` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:04.693814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e8505-5847-4b17-884f-dbdc3151761e None admin] RBAC: Authorizing `identity:get_user(user_id=d5fdf2e2dd2f4b59bee409ee6ad56548)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:04.695397 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e8505-5847-4b17-884f-dbdc3151761e None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:04.697437 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 145/291] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:04:04 2022] GET /identity/v3/users/d5fdf2e2dd2f4b59bee409ee6ad56548 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:04.704669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3142e-1172-437a-9f50-7bc72b3a7edd None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:04.846737 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3142e-1172-437a-9f50-7bc72b3a7edd None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:04.887701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814d6a7-22ff-4aaf-9b9d-62f4a0b9ca5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:04.888363 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814d6a7-22ff-4aaf-9b9d-62f4a0b9ca5d None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:04.888646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814d6a7-22ff-4aaf-9b9d-62f4a0b9ca5d None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:04.888921 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814d6a7-22ff-4aaf-9b9d-62f4a0b9ca5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:04.893059 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:04.995282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814d6a7-22ff-4aaf-9b9d-62f4a0b9ca5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:04.996796 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814d6a7-22ff-4aaf-9b9d-62f4a0b9ca5d None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:05.122156 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 147/292] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:05.127904 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e8505-5847-4b17-884f-dbdc3151761e None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:05.274368 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e8505-5847-4b17-884f-dbdc3151761e None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:05.299240 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:05.311581 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc05990-04ed-477b-a11c-0e21adbf79f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:05.312622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc05990-04ed-477b-a11c-0e21adbf79f6 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:05.313108 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc05990-04ed-477b-a11c-0e21adbf79f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:05.313592 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc05990-04ed-477b-a11c-0e21adbf79f6 None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:05.315003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc05990-04ed-477b-a11c-0e21adbf79f6 None admin] RBAC: Authorizing `identity:get_project(project_id=638dc1c8e7a34375b96fb45f061210f0)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:05.316700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc05990-04ed-477b-a11c-0e21adbf79f6 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:05.318599 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 146/293] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:05 2022] GET /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:05.325510 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814d6a7-22ff-4aaf-9b9d-62f4a0b9ca5d None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:05.386871 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:05.468968 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814d6a7-22ff-4aaf-9b9d-62f4a0b9ca5d None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:05.505263 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fb62c-1c85-4f88-9c87-5c01cf1665db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:05.505885 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fb62c-1c85-4f88-9c87-5c01cf1665db None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:05.506236 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fb62c-1c85-4f88-9c87-5c01cf1665db None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:05.506433 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fb62c-1c85-4f88-9c87-5c01cf1665db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:05.507230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fb62c-1c85-4f88-9c87-5c01cf1665db None admin] RBAC: Adding query filter params (role.id=05bb46007d644829b12b0d4ded0bd8d2, scope.project.id=638dc1c8e7a34375b96fb45f061210f0, user.id=d5fdf2e2dd2f4b59bee409ee6ad56548) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:05.507603 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fb62c-1c85-4f88-9c87-5c01cf1665db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:05.509623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fb62c-1c85-4f88-9c87-5c01cf1665db None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:05.516860 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 148/294] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:04:05 2022] GET /identity/v3/role_assignments?user.id=d5fdf2e2dd2f4b59bee409ee6ad56548&scope.project.id=638dc1c8e7a34375b96fb45f061210f0&role.id=05bb46007d644829b12b0d4ded0bd8d2 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:06.067694 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79487579-2b2d-498f-9ec5-52690bdbd210 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:06.068567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79487579-2b2d-498f-9ec5-52690bdbd210 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:06.069021 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79487579-2b2d-498f-9ec5-52690bdbd210 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:06.070871 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 147/295] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:06.076330 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92521262-1ac8-4611-991f-ed58f7887af1 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:06.076871 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92521262-1ac8-4611-991f-ed58f7887af1 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:06.077686 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92521262-1ac8-4611-991f-ed58f7887af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:06.098595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-92521262-1ac8-4611-991f-ed58f7887af1 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:06.100124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-92521262-1ac8-4611-991f-ed58f7887af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:06.193747 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 149/296] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:06.218354 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79487579-2b2d-498f-9ec5-52690bdbd210 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:06.277853 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4abe1-82a3-4566-aef9-00c750b1d3b6 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:06.278524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4abe1-82a3-4566-aef9-00c750b1d3b6 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:06.279006 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4abe1-82a3-4566-aef9-00c750b1d3b6 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:06.281031 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 150/297] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:04:06.286362 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18d4de-4850-48e8-910f-706baefce010 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:06.286891 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18d4de-4850-48e8-910f-706baefce010 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:06.287430 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18d4de-4850-48e8-910f-706baefce010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:06.312439 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-0f18d4de-4850-48e8-910f-706baefce010 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:06.313638 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-0f18d4de-4850-48e8-910f-706baefce010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:06.328651 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79487579-2b2d-498f-9ec5-52690bdbd210 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:06.341972 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:06.369190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5686bec-5041-4b9b-9b31-60099c1643ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:06.370167 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5686bec-5041-4b9b-9b31-60099c1643ca None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:06.371484 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5686bec-5041-4b9b-9b31-60099c1643ca None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:06.371792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5686bec-5041-4b9b-9b31-60099c1643ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:06.373048 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5686bec-5041-4b9b-9b31-60099c1643ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:06.374502 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5686bec-5041-4b9b-9b31-60099c1643ca None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:06.376500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 148/298] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:06.377692 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf9a99-cd62-4fcd-bb94-b87fe24377bd None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:06.377975 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf9a99-cd62-4fcd-bb94-b87fe24377bd None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:06.378249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf9a99-cd62-4fcd-bb94-b87fe24377bd None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:06.383308 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 149/299] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:06.383308 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf9a99-cd62-4fcd-bb94-b87fe24377bd None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:06.396981 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 151/300] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:04:06.398307 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfb96c-f86e-47af-ab41-f41f252135ef None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:06.398597 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfb96c-f86e-47af-ab41-f41f252135ef None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:06.398881 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfb96c-f86e-47af-ab41-f41f252135ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:06.422995 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-23dfb96c-f86e-47af-ab41-f41f252135ef None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:06.424286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-23dfb96c-f86e-47af-ab41-f41f252135ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:06.458392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:06.499759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 152/301] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:06.500638 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfb96c-f86e-47af-ab41-f41f252135ef None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:06.513968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf9a99-cd62-4fcd-bb94-b87fe24377bd None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:06.552539 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0a9b6-419f-4da8-bf43-d74cd9ca882b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:06.553178 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0a9b6-419f-4da8-bf43-d74cd9ca882b None admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:06.553462 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0a9b6-419f-4da8-bf43-d74cd9ca882b None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:06.553737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0a9b6-419f-4da8-bf43-d74cd9ca882b None admin] PATH_INFO: `/v3/groups` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:06.554406 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0a9b6-419f-4da8-bf43-d74cd9ca882b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:06.556476 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0a9b6-419f-4da8-bf43-d74cd9ca882b None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:06.577358 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 150/302] 10.222.0.71 () {60 vars in 1134 bytes} [Thu Jul 28 11:04:06 2022] POST /identity/v3/groups => generated 229 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 11:04:06.578277 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0a9b6-419f-4da8-bf43-d74cd9ca882b None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:06.637962 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:06.652295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfb96c-f86e-47af-ab41-f41f252135ef None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:06.705149 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfef1d-bd06-4a85-9b20-4ee3039bb080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:06.706996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfef1d-bd06-4a85-9b20-4ee3039bb080 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:06.707523 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfef1d-bd06-4a85-9b20-4ee3039bb080 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:06.707998 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfef1d-bd06-4a85-9b20-4ee3039bb080 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:06.716071 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0a9b6-419f-4da8-bf43-d74cd9ca882b None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:06.723686 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfef1d-bd06-4a85-9b20-4ee3039bb080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:06.731492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-32bfef1d-bd06-4a85-9b20-4ee3039bb080 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:06.731492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:06.731492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:06.731492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:06.731492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:06.731492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:06.731492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:06.731492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:06.731492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:06.731492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:06.731492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:06.731492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:06.731492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:06.731492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:06.731492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:06.731492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:06.732682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:06.732682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:06.732682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:06.732682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:06.732682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:06.732682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:06.732682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:06.732682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:06.732682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:06.732682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:06.732682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:06.732682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:06.732682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:06.732682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:06.732682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:06.732682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:06.733705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:06.733705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:06.733705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:06.733705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:06.733705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:06.733705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:06.733705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:06.733705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:06.733705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:06.733705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:06.733705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:06.733705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:06.735419 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 153/303] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:06.741063 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfef1d-bd06-4a85-9b20-4ee3039bb080 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:06.756027 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:06.772716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe151430-b954-4bfd-b32b-5b74a2ce091c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:06.774318 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe151430-b954-4bfd-b32b-5b74a2ce091c None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:06.774851 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe151430-b954-4bfd-b32b-5b74a2ce091c None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:06.775404 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe151430-b954-4bfd-b32b-5b74a2ce091c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:06.787620 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe151430-b954-4bfd-b32b-5b74a2ce091c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:06.794234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-fe151430-b954-4bfd-b32b-5b74a2ce091c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 11:04:06.794234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:06.794234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:06.794234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:06.794234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:06.794234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:06.794234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:06.794234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:06.794234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:06.794234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:06.794234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:06.794234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:06.794234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:06.794234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:06.794234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:06.794234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:06.795151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:06.795151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:06.795151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:06.795151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:06.795151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:06.795151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:06.795151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:06.795151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:06.795151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:06.795151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:06.795151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:06.795151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:06.795151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:06.795151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:06.795151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:06.795151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:06.796273 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:06.796273 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:06.796273 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:06.796273 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:06.796273 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:06.796273 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:06.796273 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:06.796273 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:06.796273 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:06.796273 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:06.796273 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 11:04:06.796273 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:06.798594 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 151/304] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:06.806812 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe151430-b954-4bfd-b32b-5b74a2ce091c None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:06.882429 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfef1d-bd06-4a85-9b20-4ee3039bb080 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:06.932674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657d80f-ddfb-4c8f-9129-acb8b3090438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:06.934494 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657d80f-ddfb-4c8f-9129-acb8b3090438 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:06.935208 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657d80f-ddfb-4c8f-9129-acb8b3090438 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:06.935941 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657d80f-ddfb-4c8f-9129-acb8b3090438 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:06.937521 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657d80f-ddfb-4c8f-9129-acb8b3090438 None admin] RBAC: Adding query filter params (name=member) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:06.938281 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657d80f-ddfb-4c8f-9129-acb8b3090438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:06.942042 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657d80f-ddfb-4c8f-9129-acb8b3090438 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:06.958903 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe151430-b954-4bfd-b32b-5b74a2ce091c None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:06.962395 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 154/305] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:04:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:06.971855 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657d80f-ddfb-4c8f-9129-acb8b3090438 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:06.998086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:07.013863 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2482be-d71c-406a-a35f-4b86bbddcddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:07.015013 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2482be-d71c-406a-a35f-4b86bbddcddd None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:07.015909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2482be-d71c-406a-a35f-4b86bbddcddd None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:07.016542 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2482be-d71c-406a-a35f-4b86bbddcddd None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:07.017536 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2482be-d71c-406a-a35f-4b86bbddcddd None admin] RBAC: Adding query filter params (name=reader) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:07.018015 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2482be-d71c-406a-a35f-4b86bbddcddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:07.020272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2482be-d71c-406a-a35f-4b86bbddcddd None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:07.032724 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 152/306] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:04:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:07.038394 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2482be-d71c-406a-a35f-4b86bbddcddd None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:07.107385 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:07.122870 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657d80f-ddfb-4c8f-9129-acb8b3090438 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:07.169941 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304b954-7144-4550-ab68-29c2b2dcc8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:07.170883 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304b954-7144-4550-ab68-29c2b2dcc8cc None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:07.171362 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304b954-7144-4550-ab68-29c2b2dcc8cc None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:07.171785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304b954-7144-4550-ab68-29c2b2dcc8cc None admin] PATH_INFO: `/v3/users/cfc26a0d35fb41cc9cd76088ad77a483` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:07.173155 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304b954-7144-4550-ab68-29c2b2dcc8cc None admin] RBAC: Authorizing `identity:get_user(user_id=cfc26a0d35fb41cc9cd76088ad77a483)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:07.175767 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304b954-7144-4550-ab68-29c2b2dcc8cc None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:07.183405 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 155/307] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:04:06 2022] GET /identity/v3/users/cfc26a0d35fb41cc9cd76088ad77a483 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:07.184666 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304b954-7144-4550-ab68-29c2b2dcc8cc None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:07.196228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2482be-d71c-406a-a35f-4b86bbddcddd None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:07.239763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7d546-68fc-4c26-89e6-2176920665c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:07.240848 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7d546-68fc-4c26-89e6-2176920665c8 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:07.241566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7d546-68fc-4c26-89e6-2176920665c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:07.242703 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7d546-68fc-4c26-89e6-2176920665c8 None admin] PATH_INFO: `/v3/users/b7f32e659be740308d5f404f4ef015a6` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:07.259657 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7d546-68fc-4c26-89e6-2176920665c8 None admin] RBAC: Authorizing `identity:get_user(user_id=b7f32e659be740308d5f404f4ef015a6)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:07.261559 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7d546-68fc-4c26-89e6-2176920665c8 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:07.263305 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 153/308] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:04:07 2022] GET /identity/v3/users/b7f32e659be740308d5f404f4ef015a6 => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:07.264511 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631fef6-4fd4-4630-9aa3-5fc01ff9793e None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:07.264796 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631fef6-4fd4-4630-9aa3-5fc01ff9793e None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:07.265077 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631fef6-4fd4-4630-9aa3-5fc01ff9793e None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:07.272449 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 154/309] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:07.272449 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631fef6-4fd4-4630-9aa3-5fc01ff9793e None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:07.287555 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:07.316779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304b954-7144-4550-ab68-29c2b2dcc8cc None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:07.362283 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c40f0-68c4-4926-ae2f-8be01d680054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:07.362976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c40f0-68c4-4926-ae2f-8be01d680054 None admin] REQUEST_METHOD: `PUT` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:07.363316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c40f0-68c4-4926-ae2f-8be01d680054 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:07.363551 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c40f0-68c4-4926-ae2f-8be01d680054 None admin] PATH_INFO: `/v3/system/users/cfc26a0d35fb41cc9cd76088ad77a483/roles/05bb46007d644829b12b0d4ded0bd8d2` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:07.365051 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c40f0-68c4-4926-ae2f-8be01d680054 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cfc26a0d35fb41cc9cd76088ad77a483, role_id=05bb46007d644829b12b0d4ded0bd8d2)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:07.366434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c40f0-68c4-4926-ae2f-8be01d680054 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:07.382017 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 156/310] 10.222.0.71 () {58 vars in 1334 bytes} [Thu Jul 28 11:04:07 2022] PUT /identity/v3/system/users/cfc26a0d35fb41cc9cd76088ad77a483/roles/05bb46007d644829b12b0d4ded0bd8d2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 11:04:07.384206 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db0f98-5628-44c5-8079-05cf87a1ea9e None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:07.384206 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db0f98-5628-44c5-8079-05cf87a1ea9e None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:07.384206 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db0f98-5628-44c5-8079-05cf87a1ea9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:07.411311 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-14db0f98-5628-44c5-8079-05cf87a1ea9e None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:07.411311 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-14db0f98-5628-44c5-8079-05cf87a1ea9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:07.442901 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:07.454170 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631fef6-4fd4-4630-9aa3-5fc01ff9793e None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:07.508141 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 157/311] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:07.510015 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c8a4e-82a0-46d6-abc6-1410187fc5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:07.510969 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c8a4e-82a0-46d6-abc6-1410187fc5b0 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:07.511255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c8a4e-82a0-46d6-abc6-1410187fc5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:07.511584 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c8a4e-82a0-46d6-abc6-1410187fc5b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:07.512390 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c8a4e-82a0-46d6-abc6-1410187fc5b0 None admin] RBAC: Adding query filter params (role.id=c29fdaefa55648b582d687cc5541fb3e, user.id=b7f32e659be740308d5f404f4ef015a6, scope.system=all) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:07.512703 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c8a4e-82a0-46d6-abc6-1410187fc5b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:07.514228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c8a4e-82a0-46d6-abc6-1410187fc5b0 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:07.526457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 155/312] 10.222.0.71 () {56 vars in 1308 bytes} [Thu Jul 28 11:04:07 2022] GET /identity/v3/role_assignments?user.id=b7f32e659be740308d5f404f4ef015a6&scope.system=all&role.id=c29fdaefa55648b582d687cc5541fb3e => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:07.533763 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db0f98-5628-44c5-8079-05cf87a1ea9e None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:07.640284 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:07.682085 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db0f98-5628-44c5-8079-05cf87a1ea9e None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:07.730117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a8e0c-a7cb-490b-a0f7-384f5c255cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:07.731215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a8e0c-a7cb-490b-a0f7-384f5c255cdf None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:07.731733 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a8e0c-a7cb-490b-a0f7-384f5c255cdf None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:07.732254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a8e0c-a7cb-490b-a0f7-384f5c255cdf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:07.745540 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a8e0c-a7cb-490b-a0f7-384f5c255cdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:07.751041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-9f4a8e0c-a7cb-490b-a0f7-384f5c255cdf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 11:04:07.751041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:07.751041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:07.751041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:07.751041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:07.751041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:07.751041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:07.751041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:07.751041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:07.751041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:07.751041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:07.751041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:07.751041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:07.751041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:07.751041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:07.751041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:07.752015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:07.752015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:07.752015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:07.752015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:07.752015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:07.752015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:07.752015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:07.752015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:07.752015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:07.752015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:07.752015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:07.752015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:07.752015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:07.752015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:07.752015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:07.752015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:07.752807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:07.752807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:07.752807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:07.752807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:07.752807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:07.752807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:07.752807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:07.752807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:07.752807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:07.752807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:07.752807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 11:04:07.752807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:07.756397 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 158/313] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:07.762837 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c8a4e-82a0-46d6-abc6-1410187fc5b0 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:07.890910 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c8a4e-82a0-46d6-abc6-1410187fc5b0 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:07.928306 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84cc0b-d83a-42dd-8e39-a54f3a6fead9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:07.928943 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84cc0b-d83a-42dd-8e39-a54f3a6fead9 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:07.929229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84cc0b-d83a-42dd-8e39-a54f3a6fead9 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:07.929621 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84cc0b-d83a-42dd-8e39-a54f3a6fead9 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:07.930352 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84cc0b-d83a-42dd-8e39-a54f3a6fead9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:07.930666 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84cc0b-d83a-42dd-8e39-a54f3a6fead9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:07.932124 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84cc0b-d83a-42dd-8e39-a54f3a6fead9 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:07.941658 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 156/314] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:04:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:07.947559 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a8e0c-a7cb-490b-a0f7-384f5c255cdf None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:08.079819 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a8e0c-a7cb-490b-a0f7-384f5c255cdf None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:08.120402 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053f5e0-3ba0-40a7-ab37-d14e5e0f5a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:08.121065 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053f5e0-3ba0-40a7-ab37-d14e5e0f5a0d None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:08.121400 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053f5e0-3ba0-40a7-ab37-d14e5e0f5a0d None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:08.121693 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053f5e0-3ba0-40a7-ab37-d14e5e0f5a0d None admin] PATH_INFO: `/v3/users/0345f23f1ef4428580f34e94d78e06d2` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:08.122885 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053f5e0-3ba0-40a7-ab37-d14e5e0f5a0d None admin] RBAC: Authorizing `identity:get_user(user_id=0345f23f1ef4428580f34e94d78e06d2)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:08.124411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053f5e0-3ba0-40a7-ab37-d14e5e0f5a0d None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:08.126397 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 159/315] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:04:07 2022] GET /identity/v3/users/0345f23f1ef4428580f34e94d78e06d2 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:08.131579 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84cc0b-d83a-42dd-8e39-a54f3a6fead9 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:08.162099 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:08.240681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84cc0b-d83a-42dd-8e39-a54f3a6fead9 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:08.277204 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c57753-04c9-405a-84c6-523294cbd781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:08.277842 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c57753-04c9-405a-84c6-523294cbd781 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:08.278130 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c57753-04c9-405a-84c6-523294cbd781 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:08.278411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c57753-04c9-405a-84c6-523294cbd781 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:08.351318 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c57753-04c9-405a-84c6-523294cbd781 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:08.352863 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c57753-04c9-405a-84c6-523294cbd781 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:08.383662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:08.465191 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 157/316] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:08.470305 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053f5e0-3ba0-40a7-ab37-d14e5e0f5a0d None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:08.473485 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:08.585137 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053f5e0-3ba0-40a7-ab37-d14e5e0f5a0d None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:08.621362 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5db1fc-fdd7-48e3-8c46-f68b6c31cb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:08.621937 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5db1fc-fdd7-48e3-8c46-f68b6c31cb3b None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:08.622217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5db1fc-fdd7-48e3-8c46-f68b6c31cb3b None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:08.622499 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5db1fc-fdd7-48e3-8c46-f68b6c31cb3b None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:08.623705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5db1fc-fdd7-48e3-8c46-f68b6c31cb3b None admin] RBAC: Authorizing `identity:get_project(project_id=638dc1c8e7a34375b96fb45f061210f0)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:08.625168 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5db1fc-fdd7-48e3-8c46-f68b6c31cb3b None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:08.627306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 160/317] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:08 2022] GET /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:08.633136 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c57753-04c9-405a-84c6-523294cbd781 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:08.743764 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c57753-04c9-405a-84c6-523294cbd781 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:08.775306 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:08.788120 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554ca04-821e-4144-a94a-4bce014f0942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:08.789277 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554ca04-821e-4144-a94a-4bce014f0942 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:08.789575 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554ca04-821e-4144-a94a-4bce014f0942 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:08.789856 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554ca04-821e-4144-a94a-4bce014f0942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:08.790671 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554ca04-821e-4144-a94a-4bce014f0942 None admin] RBAC: Adding query filter params (role.id=c29fdaefa55648b582d687cc5541fb3e, scope.project.id=638dc1c8e7a34375b96fb45f061210f0, user.id=0345f23f1ef4428580f34e94d78e06d2) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:08.790986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554ca04-821e-4144-a94a-4bce014f0942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:08.792696 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554ca04-821e-4144-a94a-4bce014f0942 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:08.799779 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 158/318] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:04:08 2022] GET /identity/v3/role_assignments?user.id=0345f23f1ef4428580f34e94d78e06d2&scope.project.id=638dc1c8e7a34375b96fb45f061210f0&role.id=c29fdaefa55648b582d687cc5541fb3e => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:09.020401 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b2fa1-e66a-440f-a05a-63849444ccd1 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:09.020896 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b2fa1-e66a-440f-a05a-63849444ccd1 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:09.021147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b2fa1-e66a-440f-a05a-63849444ccd1 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:09.022899 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 161/319] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:09.028980 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92186b-8776-4a63-bd3a-78251f45d631 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:09.029310 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92186b-8776-4a63-bd3a-78251f45d631 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:09.029550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92186b-8776-4a63-bd3a-78251f45d631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:09.048725 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-cd92186b-8776-4a63-bd3a-78251f45d631 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:09.050097 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-cd92186b-8776-4a63-bd3a-78251f45d631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:09.124187 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 159/320] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:04:09.148437 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b2fa1-e66a-440f-a05a-63849444ccd1 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:09.223166 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:09.257094 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b2fa1-e66a-440f-a05a-63849444ccd1 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:09.293114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f7334-9f87-4549-877f-152f666adb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:09.293680 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f7334-9f87-4549-877f-152f666adb9b None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:09.293961 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f7334-9f87-4549-877f-152f666adb9b None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:09.294234 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f7334-9f87-4549-877f-152f666adb9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:09.295394 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f7334-9f87-4549-877f-152f666adb9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:09.296840 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f7334-9f87-4549-877f-152f666adb9b None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:09.298423 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 162/321] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:09.304949 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92186b-8776-4a63-bd3a-78251f45d631 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:09.415202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92186b-8776-4a63-bd3a-78251f45d631 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:09.441841 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:09.458293 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb806ecf-8b07-4d20-9478-91ade8c41d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:09.458924 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb806ecf-8b07-4d20-9478-91ade8c41d69 None admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:09.459204 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb806ecf-8b07-4d20-9478-91ade8c41d69 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:09.459513 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb806ecf-8b07-4d20-9478-91ade8c41d69 None admin] PATH_INFO: `/v3/groups` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:09.460178 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb806ecf-8b07-4d20-9478-91ade8c41d69 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:09.461681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb806ecf-8b07-4d20-9478-91ade8c41d69 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:09.479002 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 160/322] 10.222.0.71 () {60 vars in 1134 bytes} [Thu Jul 28 11:04:09 2022] POST /identity/v3/groups => generated 226 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:04:09.870642 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee72cf6-3258-4548-a5f0-ea4648938063 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:09.871062 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee72cf6-3258-4548-a5f0-ea4648938063 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:09.871200 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee72cf6-3258-4548-a5f0-ea4648938063 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:09.872974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 163/323] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:09.878325 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543cacc-29a7-472a-aff7-ce4e81a8e62e None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:09.878614 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543cacc-29a7-472a-aff7-ce4e81a8e62e None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:09.878889 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543cacc-29a7-472a-aff7-ce4e81a8e62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:09.901737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-e543cacc-29a7-472a-aff7-ce4e81a8e62e None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:09.902953 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-e543cacc-29a7-472a-aff7-ce4e81a8e62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:09.937517 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb578c-b649-4a7f-a22b-b0af77dc39a7 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:09.937843 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb578c-b649-4a7f-a22b-b0af77dc39a7 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:09.938077 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb578c-b649-4a7f-a22b-b0af77dc39a7 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:09.943500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 164/324] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:04:09.944864 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52e59-f5e4-4a6b-a7f8-789b8a42a19b None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:09.945253 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52e59-f5e4-4a6b-a7f8-789b8a42a19b None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:09.945455 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52e59-f5e4-4a6b-a7f8-789b8a42a19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:09.967242 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-4df52e59-f5e4-4a6b-a7f8-789b8a42a19b None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:09.968496 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-4df52e59-f5e4-4a6b-a7f8-789b8a42a19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:09.995026 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 161/325] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:10.024735 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543cacc-29a7-472a-aff7-ce4e81a8e62e None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:10.091370 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 165/326] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:10.117812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df52e59-f5e4-4a6b-a7f8-789b8a42a19b None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:10.150044 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543cacc-29a7-472a-aff7-ce4e81a8e62e None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:10.167416 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:10.198190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0329d-d6a8-434b-8881-a355d0cdb647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:10.199493 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0329d-d6a8-434b-8881-a355d0cdb647 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:10.199776 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0329d-d6a8-434b-8881-a355d0cdb647 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:10.200055 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0329d-d6a8-434b-8881-a355d0cdb647 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:10.215394 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0329d-d6a8-434b-8881-a355d0cdb647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:10.219707 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:10.221619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-f6d0329d-d6a8-434b-8881-a355d0cdb647 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:10.221619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:10.221619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:10.221619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:10.221619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:10.221619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:10.221619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:10.221619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:10.221619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:10.221619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:10.221619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:10.221619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:10.221619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:10.221619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:10.221619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:10.221619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:10.223078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:10.223078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:10.223078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:10.223078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:10.223078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:10.223078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:10.223078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:10.223078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:10.223078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:10.223078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:10.223078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:10.223078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:10.223078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:10.223078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:10.223078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:10.223078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:10.223908 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:10.223908 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:10.223908 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:10.223908 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:10.223908 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:10.223908 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:10.223908 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:10.223908 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:10.223908 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:10.223908 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:10.223908 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:10.223908 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:10.224503 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 162/327] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:04:10.234438 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0329d-d6a8-434b-8881-a355d0cdb647 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:10.270057 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df52e59-f5e4-4a6b-a7f8-789b8a42a19b None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:10.315307 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01e4e2-1159-43bf-aff5-44b0363adbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:10.315950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01e4e2-1159-43bf-aff5-44b0363adbf4 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:10.316199 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01e4e2-1159-43bf-aff5-44b0363adbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:10.316477 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01e4e2-1159-43bf-aff5-44b0363adbf4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:10.344563 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01e4e2-1159-43bf-aff5-44b0363adbf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:10.350046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-db01e4e2-1159-43bf-aff5-44b0363adbf4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 11:04:10.350046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:10.350046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:10.350046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:10.350046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:10.350046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:10.350046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:10.350046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:10.350046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:10.350046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:10.350046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:10.350046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:10.350046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:10.350046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:10.350046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:10.350046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:10.351049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:10.351049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:10.351049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:10.351049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:10.351049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:10.351049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:10.351049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:10.351049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:10.351049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:10.351049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:10.351049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:10.351049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:10.351049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:10.351049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:10.351049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:10.351049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:10.351925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:10.351925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:10.351925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:10.351925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:10.351925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:10.351925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:10.351925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:10.351925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:10.351925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:10.351925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:10.351925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 11:04:10.351925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:10.351925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 166/328] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:10.359032 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01e4e2-1159-43bf-aff5-44b0363adbf4 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:10.398581 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0329d-d6a8-434b-8881-a355d0cdb647 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:10.455043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c42c4-8737-4880-b2ba-8639decc68d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:10.455906 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c42c4-8737-4880-b2ba-8639decc68d2 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:10.456301 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c42c4-8737-4880-b2ba-8639decc68d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:10.456587 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c42c4-8737-4880-b2ba-8639decc68d2 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:10.457693 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c42c4-8737-4880-b2ba-8639decc68d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:10.458009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c42c4-8737-4880-b2ba-8639decc68d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:10.460437 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c42c4-8737-4880-b2ba-8639decc68d2 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:10.474426 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 163/329] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:04:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:10.480611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c42c4-8737-4880-b2ba-8639decc68d2 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:10.522154 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01e4e2-1159-43bf-aff5-44b0363adbf4 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:10.525493 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:10.558301 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:10.569790 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24eae7-3552-43a5-8d4c-21b518e62b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:10.570477 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24eae7-3552-43a5-8d4c-21b518e62b7c None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:10.570763 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24eae7-3552-43a5-8d4c-21b518e62b7c None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:10.571035 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24eae7-3552-43a5-8d4c-21b518e62b7c None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:10.571810 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24eae7-3552-43a5-8d4c-21b518e62b7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:10.572118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24eae7-3552-43a5-8d4c-21b518e62b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:10.573701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24eae7-3552-43a5-8d4c-21b518e62b7c None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:10.584194 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 167/330] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:04:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:10.591669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24eae7-3552-43a5-8d4c-21b518e62b7c None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:10.623835 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c42c4-8737-4880-b2ba-8639decc68d2 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:10.669397 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b777ff-7c1f-4cd9-8f6b-ba2304499a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:10.670401 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b777ff-7c1f-4cd9-8f6b-ba2304499a4d None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:10.670877 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b777ff-7c1f-4cd9-8f6b-ba2304499a4d None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:10.671365 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b777ff-7c1f-4cd9-8f6b-ba2304499a4d None admin] PATH_INFO: `/v3/users/cfc26a0d35fb41cc9cd76088ad77a483` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:10.673444 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b777ff-7c1f-4cd9-8f6b-ba2304499a4d None admin] RBAC: Authorizing `identity:get_user(user_id=cfc26a0d35fb41cc9cd76088ad77a483)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:10.675222 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b777ff-7c1f-4cd9-8f6b-ba2304499a4d None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:10.677524 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 164/331] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:04:10 2022] GET /identity/v3/users/cfc26a0d35fb41cc9cd76088ad77a483 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:10.684258 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b777ff-7c1f-4cd9-8f6b-ba2304499a4d None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:10.832092 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:10.839381 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b777ff-7c1f-4cd9-8f6b-ba2304499a4d None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:10.882882 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8576f3e-bdfa-4882-b831-4e8b851e84b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:10.883964 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8576f3e-bdfa-4882-b831-4e8b851e84b2 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:10.884539 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8576f3e-bdfa-4882-b831-4e8b851e84b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:10.884990 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8576f3e-bdfa-4882-b831-4e8b851e84b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:10.886224 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8576f3e-bdfa-4882-b831-4e8b851e84b2 None admin] RBAC: Adding query filter params (role.id=05bb46007d644829b12b0d4ded0bd8d2, user.id=cfc26a0d35fb41cc9cd76088ad77a483, scope.system=all) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:10.886781 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8576f3e-bdfa-4882-b831-4e8b851e84b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:10.889046 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8576f3e-bdfa-4882-b831-4e8b851e84b2 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:10.903993 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 165/332] 10.222.0.71 () {56 vars in 1308 bytes} [Thu Jul 28 11:04:10 2022] GET /identity/v3/role_assignments?user.id=cfc26a0d35fb41cc9cd76088ad77a483&scope.system=all&role.id=05bb46007d644829b12b0d4ded0bd8d2 => generated 510 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:10.921470 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24eae7-3552-43a5-8d4c-21b518e62b7c None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:10.967909 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f74412-7540-4c26-9a27-e86ae8042188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:10.968591 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f74412-7540-4c26-9a27-e86ae8042188 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:10.968880 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f74412-7540-4c26-9a27-e86ae8042188 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:10.969164 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f74412-7540-4c26-9a27-e86ae8042188 None admin] PATH_INFO: `/v3/users/b7f32e659be740308d5f404f4ef015a6` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:10.972398 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f74412-7540-4c26-9a27-e86ae8042188 None admin] RBAC: Authorizing `identity:get_user(user_id=b7f32e659be740308d5f404f4ef015a6)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:10.973896 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f74412-7540-4c26-9a27-e86ae8042188 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:10.975926 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 168/333] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:04:10 2022] GET /identity/v3/users/b7f32e659be740308d5f404f4ef015a6 => generated 293 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:10.981865 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8576f3e-bdfa-4882-b831-4e8b851e84b2 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:11.129828 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8576f3e-bdfa-4882-b831-4e8b851e84b2 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:11.184213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbff7b-17dc-46fe-a9c6-ced1d28cc6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:11.185371 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbff7b-17dc-46fe-a9c6-ced1d28cc6b5 None admin] REQUEST_METHOD: `PUT` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:11.185851 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbff7b-17dc-46fe-a9c6-ced1d28cc6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:11.186333 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbff7b-17dc-46fe-a9c6-ced1d28cc6b5 None admin] PATH_INFO: `/v3/system/users/b7f32e659be740308d5f404f4ef015a6/roles/c29fdaefa55648b582d687cc5541fb3e` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:11.188308 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbff7b-17dc-46fe-a9c6-ced1d28cc6b5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b7f32e659be740308d5f404f4ef015a6, role_id=c29fdaefa55648b582d687cc5541fb3e)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:11.190112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbff7b-17dc-46fe-a9c6-ced1d28cc6b5 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:11.204229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 166/334] 10.222.0.71 () {58 vars in 1334 bytes} [Thu Jul 28 11:04:10 2022] PUT /identity/v3/system/users/b7f32e659be740308d5f404f4ef015a6/roles/c29fdaefa55648b582d687cc5541fb3e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:04:12.584419 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f4186-7de6-4abb-aaf1-f9749d6c3a1d None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:12.585422 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f4186-7de6-4abb-aaf1-f9749d6c3a1d None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:12.585960 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f4186-7de6-4abb-aaf1-f9749d6c3a1d None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:12.587865 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 169/335] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:12.608266 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97662b71-fea0-4a8c-8048-af4bfb274ab4 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:12.609196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97662b71-fea0-4a8c-8048-af4bfb274ab4 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:12.609703 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97662b71-fea0-4a8c-8048-af4bfb274ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:12.631882 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-97662b71-fea0-4a8c-8048-af4bfb274ab4 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:12.634143 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-97662b71-fea0-4a8c-8048-af4bfb274ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:12.657571 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:12.719898 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 167/336] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:12.764745 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f4186-7de6-4abb-aaf1-f9749d6c3a1d None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:12.885905 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:12.940901 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f4186-7de6-4abb-aaf1-f9749d6c3a1d None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:12.983254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e46cf-1839-4f96-ae98-95297ae3aa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:12.984337 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e46cf-1839-4f96-ae98-95297ae3aa95 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:12.984859 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e46cf-1839-4f96-ae98-95297ae3aa95 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:12.985328 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e46cf-1839-4f96-ae98-95297ae3aa95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:13.001075 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e46cf-1839-4f96-ae98-95297ae3aa95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:13.007174 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-fd5e46cf-1839-4f96-ae98-95297ae3aa95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:13.007174 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:13.007174 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:13.007174 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:13.007174 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:13.007174 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:13.007174 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:13.007174 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:13.007174 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:13.007174 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:13.007174 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:13.007174 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:13.007174 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:13.007174 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:13.007174 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:13.007174 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:13.008114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:13.008114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:13.008114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:13.008114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:13.008114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:13.008114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:13.008114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:13.008114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:13.008114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:13.008114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:13.008114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:13.008114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:13.008114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:13.008114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:13.008114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:13.008114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:13.008890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:13.008890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:13.008890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:13.008890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:13.008890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:13.008890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:13.008890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:13.008890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:13.008890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:13.008890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:13.008890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:13.008890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:13.011581 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 170/337] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:04:13.021031 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97662b71-fea0-4a8c-8048-af4bfb274ab4 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:13.076559 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9bb73-8079-4167-ac99-119a64adb39f None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:13.077489 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9bb73-8079-4167-ac99-119a64adb39f None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:13.078396 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9bb73-8079-4167-ac99-119a64adb39f None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:13.080645 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 171/338] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:04:13.087743 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bdfb1-86b8-46ee-bda3-357ff9790fa4 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:13.088480 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bdfb1-86b8-46ee-bda3-357ff9790fa4 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:13.088991 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bdfb1-86b8-46ee-bda3-357ff9790fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:13.116638 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-252bdfb1-86b8-46ee-bda3-357ff9790fa4 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:13.118420 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-252bdfb1-86b8-46ee-bda3-357ff9790fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:13.167307 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97662b71-fea0-4a8c-8048-af4bfb274ab4 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:13.217896 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8295a-5e2f-41d4-a4e9-8f0f6c878502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:13.220188 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8295a-5e2f-41d4-a4e9-8f0f6c878502 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:13.221737 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 172/339] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:13.222265 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8295a-5e2f-41d4-a4e9-8f0f6c878502 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:13.222763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8295a-5e2f-41d4-a4e9-8f0f6c878502 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:13.223751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8295a-5e2f-41d4-a4e9-8f0f6c878502 None admin] RBAC: Adding query filter params (name=member) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:13.224345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8295a-5e2f-41d4-a4e9-8f0f6c878502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:13.225934 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8295a-5e2f-41d4-a4e9-8f0f6c878502 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:13.239752 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 168/340] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:04:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:13.245726 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bdfb1-86b8-46ee-bda3-357ff9790fa4 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:13.266555 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8295a-5e2f-41d4-a4e9-8f0f6c878502 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:13.290737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:13.333157 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:13.394190 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bdfb1-86b8-46ee-bda3-357ff9790fa4 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:13.446402 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5acb5-fa57-4658-b954-2d0998995dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:13.447455 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5acb5-fa57-4658-b954-2d0998995dd1 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:13.447892 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5acb5-fa57-4658-b954-2d0998995dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:13.448430 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5acb5-fa57-4658-b954-2d0998995dd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:13.533200 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8295a-5e2f-41d4-a4e9-8f0f6c878502 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:13.624983 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6e20a-62bc-4eca-aae9-8edc1334c166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:13.626402 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6e20a-62bc-4eca-aae9-8edc1334c166 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:13.627675 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6e20a-62bc-4eca-aae9-8edc1334c166 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:13.628148 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6e20a-62bc-4eca-aae9-8edc1334c166 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:13.636586 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5acb5-fa57-4658-b954-2d0998995dd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:13.638747 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5acb5-fa57-4658-b954-2d0998995dd1 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:13.654648 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6e20a-62bc-4eca-aae9-8edc1334c166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:13.660214 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-76e6e20a-62bc-4eca-aae9-8edc1334c166 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:04:13.660214 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:13.660214 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:13.660214 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:13.660214 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:13.660214 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:13.660214 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:13.660214 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:13.660214 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:13.660214 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:13.660214 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:13.660214 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:13.660214 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:13.660214 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:13.660214 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:13.660214 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:13.661345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:13.661345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:13.661345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:13.661345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:13.661345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:13.661345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:13.661345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:13.661345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:13.661345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:13.661345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:13.661345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:13.661345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:13.661345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:13.661345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:13.661345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:13.661345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:13.662340 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:13.662340 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:13.662340 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:13.662340 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:13.662340 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:13.662340 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:13.662340 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:13.662340 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:13.662340 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:13.662340 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:13.662340 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:04:13.662340 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:13.666830 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 169/341] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:04:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:04:13.668088 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6e20a-62bc-4eca-aae9-8edc1334c166 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:13.755885 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:13.791984 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:13.846138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6e20a-62bc-4eca-aae9-8edc1334c166 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:13.876304 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 173/342] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:13.878875 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf053dc-8cb1-4592-af75-f3c5ec5f118c None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:13.881146 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf053dc-8cb1-4592-af75-f3c5ec5f118c None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:13.882278 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf053dc-8cb1-4592-af75-f3c5ec5f118c None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:13.884216 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 174/343] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:13.888253 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf053dc-8cb1-4592-af75-f3c5ec5f118c None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:13.927720 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4f0f0-e553-4a02-b6f3-cf543d9824e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:13.928604 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4f0f0-e553-4a02-b6f3-cf543d9824e9 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:13.929032 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4f0f0-e553-4a02-b6f3-cf543d9824e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:13.929516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4f0f0-e553-4a02-b6f3-cf543d9824e9 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:13.930905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4f0f0-e553-4a02-b6f3-cf543d9824e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:13.932518 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4f0f0-e553-4a02-b6f3-cf543d9824e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:13.934071 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4f0f0-e553-4a02-b6f3-cf543d9824e9 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:13.947223 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 170/344] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:13.948792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb197854-5934-4f8c-984d-a351e5661992 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:13.949256 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb197854-5934-4f8c-984d-a351e5661992 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:13.949677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb197854-5934-4f8c-984d-a351e5661992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:13.981895 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-bb197854-5934-4f8c-984d-a351e5661992 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:13.986009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-bb197854-5934-4f8c-984d-a351e5661992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:14.056543 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf053dc-8cb1-4592-af75-f3c5ec5f118c None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:14.096269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77d811-ece4-4c88-98f9-6ea3a3975c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:14.096941 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77d811-ece4-4c88-98f9-6ea3a3975c53 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:14.097228 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77d811-ece4-4c88-98f9-6ea3a3975c53 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:14.097506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77d811-ece4-4c88-98f9-6ea3a3975c53 None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:14.098692 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77d811-ece4-4c88-98f9-6ea3a3975c53 None admin] RBAC: Authorizing `identity:get_project(project_id=19ee209183e74289b7ddcfce7e067a7a)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:14.100227 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77d811-ece4-4c88-98f9-6ea3a3975c53 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:14.101982 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 175/345] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:13 2022] GET /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:14.102817 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77d811-ece4-4c88-98f9-6ea3a3975c53 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:14.112871 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 171/346] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:14.113794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb197854-5934-4f8c-984d-a351e5661992 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:14.134084 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:14.212542 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:14.258632 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb197854-5934-4f8c-984d-a351e5661992 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:14.259586 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77d811-ece4-4c88-98f9-6ea3a3975c53 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:14.299569 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67781d90-2543-43e0-81bd-d444c6bdfa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:14.299931 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562945d-bae0-4748-835a-6f6e857ae685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:14.300210 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67781d90-2543-43e0-81bd-d444c6bdfa5a None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:14.300513 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562945d-bae0-4748-835a-6f6e857ae685 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:14.300612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67781d90-2543-43e0-81bd-d444c6bdfa5a None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:14.300797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562945d-bae0-4748-835a-6f6e857ae685 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:14.300902 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67781d90-2543-43e0-81bd-d444c6bdfa5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:14.301077 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562945d-bae0-4748-835a-6f6e857ae685 None admin] PATH_INFO: `/v3/groups/dc732aa2652641d99c127014d8a881fb` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:14.309229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562945d-bae0-4748-835a-6f6e857ae685 None admin] RBAC: Authorizing `identity:get_group(group_id=dc732aa2652641d99c127014d8a881fb)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:14.310691 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562945d-bae0-4748-835a-6f6e857ae685 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:14.313314 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 172/347] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Jul 28 11:04:14 2022] GET /identity/v3/groups/dc732aa2652641d99c127014d8a881fb => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:14.314115 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562945d-bae0-4748-835a-6f6e857ae685 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:14.384144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67781d90-2543-43e0-81bd-d444c6bdfa5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:14.386226 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67781d90-2543-43e0-81bd-d444c6bdfa5a None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:14.406113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:14.434550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562945d-bae0-4748-835a-6f6e857ae685 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:14.466784 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:14.477338 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd00cc-6949-4943-bdc4-10eb934a39a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:14.478470 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd00cc-6949-4943-bdc4-10eb934a39a3 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:14.478470 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd00cc-6949-4943-bdc4-10eb934a39a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:14.478664 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd00cc-6949-4943-bdc4-10eb934a39a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:14.490036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd00cc-6949-4943-bdc4-10eb934a39a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:14.496677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-3cdd00cc-6949-4943-bdc4-10eb934a39a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:14.496677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:14.496677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:14.496677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:14.496677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:14.496677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:14.496677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:14.496677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:14.496677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:14.496677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:14.496677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:14.496677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:14.496677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:14.496677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:14.496677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:14.496677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:14.497810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:14.497810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:14.497810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:14.497810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:14.497810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:14.497810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:14.497810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:14.497810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:14.497810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:14.497810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:14.497810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:14.497810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:14.497810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:14.497810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:14.497810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:14.497810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:14.498802 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:14.498802 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:14.498802 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:14.498802 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:14.498802 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:14.498802 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:14.498802 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:14.498802 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:14.498802 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:14.498802 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:14.498802 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:14.498802 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:14.502744 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 173/348] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:14.504151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679aca47-b90b-4f2e-9fea-d5403747f045 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:14.504440 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679aca47-b90b-4f2e-9fea-d5403747f045 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:14.504716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679aca47-b90b-4f2e-9fea-d5403747f045 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:14.506609 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 174/349] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:14.507415 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679aca47-b90b-4f2e-9fea-d5403747f045 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:14.513880 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 176/350] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:14.515001 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67781d90-2543-43e0-81bd-d444c6bdfa5a None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:14.635343 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679aca47-b90b-4f2e-9fea-d5403747f045 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:14.639289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67781d90-2543-43e0-81bd-d444c6bdfa5a None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:14.660084 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:14.672602 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40efb1f-4f4f-47e5-9ff8-0310c531d475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:14.673231 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40efb1f-4f4f-47e5-9ff8-0310c531d475 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:14.673510 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40efb1f-4f4f-47e5-9ff8-0310c531d475 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:14.673787 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40efb1f-4f4f-47e5-9ff8-0310c531d475 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:14.674592 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40efb1f-4f4f-47e5-9ff8-0310c531d475 None admin] RBAC: Adding query filter params (group.id=dc732aa2652641d99c127014d8a881fb, role.id=05bb46007d644829b12b0d4ded0bd8d2, scope.project.id=19ee209183e74289b7ddcfce7e067a7a) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:14.674905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40efb1f-4f4f-47e5-9ff8-0310c531d475 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:14.676394 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40efb1f-4f4f-47e5-9ff8-0310c531d475 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:14.681682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65f059-39bb-47a2-be3e-0710d8b0cdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:14.682617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65f059-39bb-47a2-be3e-0710d8b0cdc0 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:14.683105 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65f059-39bb-47a2-be3e-0710d8b0cdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:14.683840 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65f059-39bb-47a2-be3e-0710d8b0cdc0 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:14.684761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65f059-39bb-47a2-be3e-0710d8b0cdc0 None admin] RBAC: Adding query filter params (name=member) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:14.685254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65f059-39bb-47a2-be3e-0710d8b0cdc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:14.687683 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 175/351] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Jul 28 11:04:14 2022] GET /identity/v3/role_assignments?group.id=dc732aa2652641d99c127014d8a881fb&scope.project.id=19ee209183e74289b7ddcfce7e067a7a&role.id=05bb46007d644829b12b0d4ded0bd8d2 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:14.688295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65f059-39bb-47a2-be3e-0710d8b0cdc0 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:14.689973 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2ee90-8bee-42b1-8711-d1362bcb0eb6 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:14.692419 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2ee90-8bee-42b1-8711-d1362bcb0eb6 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:14.692947 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2ee90-8bee-42b1-8711-d1362bcb0eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:14.710331 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 177/352] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:04:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:14.712291 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65f059-39bb-47a2-be3e-0710d8b0cdc0 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:14.730661 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-9ba2ee90-8bee-42b1-8711-d1362bcb0eb6 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:14.731944 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-9ba2ee90-8bee-42b1-8711-d1362bcb0eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:14.841473 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65f059-39bb-47a2-be3e-0710d8b0cdc0 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:14.855021 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:14.885862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72493255-7c6c-4118-8249-ce254b399f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:14.886953 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72493255-7c6c-4118-8249-ce254b399f37 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:14.887488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72493255-7c6c-4118-8249-ce254b399f37 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:14.887967 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72493255-7c6c-4118-8249-ce254b399f37 None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:14.890598 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72493255-7c6c-4118-8249-ce254b399f37 None admin] RBAC: Authorizing `identity:get_project(project_id=19ee209183e74289b7ddcfce7e067a7a)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:14.892449 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72493255-7c6c-4118-8249-ce254b399f37 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:14.894545 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 178/353] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:14 2022] GET /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:14.895643 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72493255-7c6c-4118-8249-ce254b399f37 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:14.920851 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 176/354] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:14.921883 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2ee90-8bee-42b1-8711-d1362bcb0eb6 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:14.955625 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:15.043235 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72493255-7c6c-4118-8249-ce254b399f37 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:15.088082 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782812b8-eae7-423c-97b8-141320daf361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:15.089109 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782812b8-eae7-423c-97b8-141320daf361 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:15.089603 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782812b8-eae7-423c-97b8-141320daf361 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:15.090090 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782812b8-eae7-423c-97b8-141320daf361 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:15.090907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2ee90-8bee-42b1-8711-d1362bcb0eb6 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:15.135151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c740c79-2ad1-4e63-b359-8d6bc16cc5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:15.136196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c740c79-2ad1-4e63-b359-8d6bc16cc5e1 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:15.136422 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c740c79-2ad1-4e63-b359-8d6bc16cc5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:15.136698 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c740c79-2ad1-4e63-b359-8d6bc16cc5e1 None admin] PATH_INFO: `/v3/groups/dc732aa2652641d99c127014d8a881fb` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:15.138021 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c740c79-2ad1-4e63-b359-8d6bc16cc5e1 None admin] RBAC: Authorizing `identity:get_group(group_id=dc732aa2652641d99c127014d8a881fb)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:15.139698 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c740c79-2ad1-4e63-b359-8d6bc16cc5e1 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:15.141733 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 177/355] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Jul 28 11:04:14 2022] GET /identity/v3/groups/dc732aa2652641d99c127014d8a881fb => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:15.142640 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c740c79-2ad1-4e63-b359-8d6bc16cc5e1 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:15.190100 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782812b8-eae7-423c-97b8-141320daf361 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:15.192492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782812b8-eae7-423c-97b8-141320daf361 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:15.204492 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:15.255563 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:15.265220 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c740c79-2ad1-4e63-b359-8d6bc16cc5e1 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:15.310805 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3612b-910f-4496-b6d0-f6f124f639ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:15.311770 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3612b-910f-4496-b6d0-f6f124f639ae None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:15.311917 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3612b-910f-4496-b6d0-f6f124f639ae None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:15.312246 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3612b-910f-4496-b6d0-f6f124f639ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:15.324490 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3612b-910f-4496-b6d0-f6f124f639ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:15.330263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-0ac3612b-910f-4496-b6d0-f6f124f639ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:04:15.330263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:15.330263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:15.330263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:15.330263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:15.330263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:15.330263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:15.330263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:15.330263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:15.330263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:15.330263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:15.330263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:15.330263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:15.330263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:15.330263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:15.330263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:15.331190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:15.331190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:15.331190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:15.331190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:15.331190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:15.331190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:15.331190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:15.331190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:15.331190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:15.331190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:15.331190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:15.331190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:15.331190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:15.331190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:15.331190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:15.331190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:15.332568 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:15.332568 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:15.332568 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:15.332568 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:15.332568 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:15.332568 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:15.332568 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:15.332568 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:15.332568 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:15.332568 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:15.332568 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:04:15.332568 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:15.332568 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 178/356] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:04:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:15.335616 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 179/357] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:15.335616 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782812b8-eae7-423c-97b8-141320daf361 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:15.336833 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408e69f-055a-4c2f-80f9-761789218600 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:15.337210 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408e69f-055a-4c2f-80f9-761789218600 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:15.337401 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408e69f-055a-4c2f-80f9-761789218600 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:15.340133 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 179/358] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:15.340133 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc5c52-41b5-49b0-865d-8c61a02175d8 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:15.340315 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc5c52-41b5-49b0-865d-8c61a02175d8 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:15.343303 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc5c52-41b5-49b0-865d-8c61a02175d8 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:15.343303 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 180/359] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:15.344021 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc5c52-41b5-49b0-865d-8c61a02175d8 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:15.475375 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782812b8-eae7-423c-97b8-141320daf361 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:15.493064 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc5c52-41b5-49b0-865d-8c61a02175d8 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:15.511412 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:15.523755 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b3c2d-193e-4949-bfd8-044c2b856efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:15.524496 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b3c2d-193e-4949-bfd8-044c2b856efc None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:15.524876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b3c2d-193e-4949-bfd8-044c2b856efc None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:15.525163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b3c2d-193e-4949-bfd8-044c2b856efc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:15.526141 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b3c2d-193e-4949-bfd8-044c2b856efc None admin] RBAC: Adding query filter params (group.id=dc732aa2652641d99c127014d8a881fb, role.id=e1248e4ba8a34052820e6bd72cdd8b72, scope.project.id=19ee209183e74289b7ddcfce7e067a7a) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:15.526464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b3c2d-193e-4949-bfd8-044c2b856efc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:15.528687 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b3c2d-193e-4949-bfd8-044c2b856efc None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:15.537257 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 180/360] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Jul 28 11:04:15 2022] GET /identity/v3/role_assignments?group.id=dc732aa2652641d99c127014d8a881fb&scope.project.id=19ee209183e74289b7ddcfce7e067a7a&role.id=e1248e4ba8a34052820e6bd72cdd8b72 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:15.538087 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b3c2d-193e-4949-bfd8-044c2b856efc None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:15.541650 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f858b4-edd5-41d6-88f8-bdceaf154b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:15.543587 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f858b4-edd5-41d6-88f8-bdceaf154b82 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:15.544081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f858b4-edd5-41d6-88f8-bdceaf154b82 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:15.544625 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f858b4-edd5-41d6-88f8-bdceaf154b82 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:15.545635 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f858b4-edd5-41d6-88f8-bdceaf154b82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:15.546150 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f858b4-edd5-41d6-88f8-bdceaf154b82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:15.547865 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f858b4-edd5-41d6-88f8-bdceaf154b82 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:15.554093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:15.566307 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 181/361] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:15.567982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a5c16-949e-475c-a961-6a5d2bd4dafb None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:15.568465 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a5c16-949e-475c-a961-6a5d2bd4dafb None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:15.569671 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a5c16-949e-475c-a961-6a5d2bd4dafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:15.595682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-bc7a5c16-949e-475c-a961-6a5d2bd4dafb None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:15.596991 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-bc7a5c16-949e-475c-a961-6a5d2bd4dafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:15.701273 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b3c2d-193e-4949-bfd8-044c2b856efc None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:15.714507 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 182/362] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:15.716713 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d48c8-0a44-441e-9fde-81c652d32ad3 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:15.717286 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d48c8-0a44-441e-9fde-81c652d32ad3 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:15.717861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d48c8-0a44-441e-9fde-81c652d32ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:15.750432 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac46fa-9695-4094-a5ec-c3c6c12850e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:15.751234 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac46fa-9695-4094-a5ec-c3c6c12850e0 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:15.751797 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac46fa-9695-4094-a5ec-c3c6c12850e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:15.752281 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac46fa-9695-4094-a5ec-c3c6c12850e0 None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:15.756091 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac46fa-9695-4094-a5ec-c3c6c12850e0 None admin] RBAC: Authorizing `identity:get_project(project_id=638dc1c8e7a34375b96fb45f061210f0)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:15.758168 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac46fa-9695-4094-a5ec-c3c6c12850e0 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:15.761804 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-439d48c8-0a44-441e-9fde-81c652d32ad3 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:15.763042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-439d48c8-0a44-441e-9fde-81c652d32ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:15.775728 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 181/363] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:15 2022] GET /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:15.776826 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac46fa-9695-4094-a5ec-c3c6c12850e0 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:15.878960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 183/364] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:15.879888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d48c8-0a44-441e-9fde-81c652d32ad3 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:15.880477 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:15.926109 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac46fa-9695-4094-a5ec-c3c6c12850e0 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:15.937660 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:15.983988 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653865e0-8684-4cd8-8078-d6bc1a11d1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:15.984635 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653865e0-8684-4cd8-8078-d6bc1a11d1de None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:15.984918 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653865e0-8684-4cd8-8078-d6bc1a11d1de None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:15.985198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653865e0-8684-4cd8-8078-d6bc1a11d1de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:16.028983 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d48c8-0a44-441e-9fde-81c652d32ad3 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:16.079132 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91b4fe-5cd8-4bc7-a8f1-4bc0c66e5065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:16.079839 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91b4fe-5cd8-4bc7-a8f1-4bc0c66e5065 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:16.080123 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91b4fe-5cd8-4bc7-a8f1-4bc0c66e5065 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:16.080399 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91b4fe-5cd8-4bc7-a8f1-4bc0c66e5065 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:16.096840 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91b4fe-5cd8-4bc7-a8f1-4bc0c66e5065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:16.103146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-1b91b4fe-5cd8-4bc7-a8f1-4bc0c66e5065 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 11:04:16.103146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:16.103146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:16.103146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:16.103146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:16.103146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:16.103146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:16.103146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:16.103146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:16.103146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:16.103146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:16.103146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:16.103146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:16.103146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:16.103146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:16.103146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:16.104800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:16.104800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:16.104800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:16.104800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:16.104800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:16.104800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:16.104800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:16.104800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:16.104800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:16.104800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:16.104800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:16.104800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:16.104800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:16.104800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:16.104800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:16.104800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:16.106220 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:16.106220 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:16.106220 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:16.106220 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:16.106220 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:16.106220 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:16.106220 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:16.106220 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:16.106220 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:16.106220 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:16.106220 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 11:04:16.106220 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:16.106220 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 184/365] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:16.106220 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91b4fe-5cd8-4bc7-a8f1-4bc0c66e5065 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:16.123683 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653865e0-8684-4cd8-8078-d6bc1a11d1de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:16.127584 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653865e0-8684-4cd8-8078-d6bc1a11d1de None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:16.240576 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:16.246950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:16.255854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91b4fe-5cd8-4bc7-a8f1-4bc0c66e5065 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:16.273372 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 182/366] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:16.273721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653865e0-8684-4cd8-8078-d6bc1a11d1de None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:16.315926 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a453d-c204-4454-bab0-611673bc8823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:16.316592 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a453d-c204-4454-bab0-611673bc8823 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:16.316865 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a453d-c204-4454-bab0-611673bc8823 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:16.317140 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a453d-c204-4454-bab0-611673bc8823 None admin] PATH_INFO: `/v3/groups/dc732aa2652641d99c127014d8a881fb` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:16.319234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a453d-c204-4454-bab0-611673bc8823 None admin] RBAC: Authorizing `identity:get_group(group_id=dc732aa2652641d99c127014d8a881fb)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:16.320844 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a453d-c204-4454-bab0-611673bc8823 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:16.322616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 185/367] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Jul 28 11:04:16 2022] GET /identity/v3/groups/dc732aa2652641d99c127014d8a881fb => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:16.323503 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a453d-c204-4454-bab0-611673bc8823 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:16.395130 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653865e0-8684-4cd8-8078-d6bc1a11d1de None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:16.439030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d8b6c-e77c-4557-b431-a697b11d6da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:16.439747 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d8b6c-e77c-4557-b431-a697b11d6da9 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:16.440100 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d8b6c-e77c-4557-b431-a697b11d6da9 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:16.440382 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d8b6c-e77c-4557-b431-a697b11d6da9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:16.446053 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a453d-c204-4454-bab0-611673bc8823 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:16.453628 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d8b6c-e77c-4557-b431-a697b11d6da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:16.459124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-699d8b6c-e77c-4557-b431-a697b11d6da9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:04:16.459124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:16.459124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:16.459124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:16.459124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:16.459124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:16.459124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:16.459124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:16.459124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:16.459124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:16.459124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:16.459124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:16.459124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:16.459124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:16.459124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:16.459124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:16.460721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:16.460721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:16.460721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:16.460721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:16.460721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:16.460721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:16.460721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:16.460721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:16.460721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:16.460721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:16.460721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:16.460721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:16.460721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:16.460721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:16.460721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:16.460721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:16.463050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:16.463050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:16.463050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:16.463050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:16.463050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:16.463050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:16.463050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:16.463050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:16.463050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:16.463050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:16.463050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:04:16.463050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:16.463050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 183/368] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Jul 28 11:04:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:16.463050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d8b6c-e77c-4557-b431-a697b11d6da9 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:16.497906 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5fc9b-fcf8-4297-ad46-8de7e3c785d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:16.499343 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5fc9b-fcf8-4297-ad46-8de7e3c785d3 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:16.500171 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5fc9b-fcf8-4297-ad46-8de7e3c785d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:16.500891 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5fc9b-fcf8-4297-ad46-8de7e3c785d3 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:16.502357 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5fc9b-fcf8-4297-ad46-8de7e3c785d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:16.503118 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5fc9b-fcf8-4297-ad46-8de7e3c785d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:16.505855 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5fc9b-fcf8-4297-ad46-8de7e3c785d3 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:16.512507 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:16.526517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 186/369] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:04:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:16.528400 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5fc9b-fcf8-4297-ad46-8de7e3c785d3 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:16.578490 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:16.583831 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d8b6c-e77c-4557-b431-a697b11d6da9 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:16.627066 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5a3ab-0a09-47f1-91b5-43f34ceffd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:16.627066 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5a3ab-0a09-47f1-91b5-43f34ceffd25 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:16.627066 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5a3ab-0a09-47f1-91b5-43f34ceffd25 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:16.627066 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5a3ab-0a09-47f1-91b5-43f34ceffd25 None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:16.628532 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5a3ab-0a09-47f1-91b5-43f34ceffd25 None admin] RBAC: Authorizing `identity:get_project(project_id=638dc1c8e7a34375b96fb45f061210f0)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:16.630011 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5a3ab-0a09-47f1-91b5-43f34ceffd25 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:16.635292 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 184/370] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:16 2022] GET /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:16.635292 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5a3ab-0a09-47f1-91b5-43f34ceffd25 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:16.708534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5fc9b-fcf8-4297-ad46-8de7e3c785d3 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:16.763022 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5c873-1ab4-4df0-8a3e-0c04670d7f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:16.763696 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5c873-1ab4-4df0-8a3e-0c04670d7f28 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:16.764016 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5c873-1ab4-4df0-8a3e-0c04670d7f28 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:16.764311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5c873-1ab4-4df0-8a3e-0c04670d7f28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:16.765117 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5c873-1ab4-4df0-8a3e-0c04670d7f28 None admin] RBAC: Adding query filter params (group.id=dc732aa2652641d99c127014d8a881fb, role.id=05bb46007d644829b12b0d4ded0bd8d2, scope.project.id=638dc1c8e7a34375b96fb45f061210f0) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:16.765433 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5c873-1ab4-4df0-8a3e-0c04670d7f28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:16.766426 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5a3ab-0a09-47f1-91b5-43f34ceffd25 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:16.766887 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5c873-1ab4-4df0-8a3e-0c04670d7f28 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:16.774715 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 187/371] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Jul 28 11:04:16 2022] GET /identity/v3/role_assignments?group.id=dc732aa2652641d99c127014d8a881fb&scope.project.id=638dc1c8e7a34375b96fb45f061210f0&role.id=05bb46007d644829b12b0d4ded0bd8d2 => generated 260 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:16.776055 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5c873-1ab4-4df0-8a3e-0c04670d7f28 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:16.782738 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:16.835588 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf552900-2f0a-4a37-b3d4-9c05581bce78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:16.838036 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf552900-2f0a-4a37-b3d4-9c05581bce78 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:16.838623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf552900-2f0a-4a37-b3d4-9c05581bce78 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:16.839976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf552900-2f0a-4a37-b3d4-9c05581bce78 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:16.840931 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf552900-2f0a-4a37-b3d4-9c05581bce78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:16.842169 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf552900-2f0a-4a37-b3d4-9c05581bce78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:16.844100 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf552900-2f0a-4a37-b3d4-9c05581bce78 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:16.864586 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 185/372] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:16.865773 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf552900-2f0a-4a37-b3d4-9c05581bce78 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:17.004300 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:17.007009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf552900-2f0a-4a37-b3d4-9c05581bce78 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:17.033406 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5c873-1ab4-4df0-8a3e-0c04670d7f28 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:17.047363 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e73e50-3277-4ae3-a4ca-0df011534960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:17.048059 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e73e50-3277-4ae3-a4ca-0df011534960 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:17.048323 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e73e50-3277-4ae3-a4ca-0df011534960 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:17.048607 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e73e50-3277-4ae3-a4ca-0df011534960 None admin] PATH_INFO: `/v3/groups/dc732aa2652641d99c127014d8a881fb` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:17.049836 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e73e50-3277-4ae3-a4ca-0df011534960 None admin] RBAC: Authorizing `identity:get_group(group_id=dc732aa2652641d99c127014d8a881fb)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:17.051248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e73e50-3277-4ae3-a4ca-0df011534960 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:17.052895 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 186/373] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Jul 28 11:04:16 2022] GET /identity/v3/groups/dc732aa2652641d99c127014d8a881fb => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:17.054043 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e73e50-3277-4ae3-a4ca-0df011534960 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:17.091716 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:17.124907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edac63-c8ff-42d9-b67a-6d5fe8c5bba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:17.125571 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edac63-c8ff-42d9-b67a-6d5fe8c5bba9 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:17.125856 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edac63-c8ff-42d9-b67a-6d5fe8c5bba9 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:17.126132 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edac63-c8ff-42d9-b67a-6d5fe8c5bba9 None admin] PATH_INFO: `/v3/users/b7f32e659be740308d5f404f4ef015a6` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:17.132062 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edac63-c8ff-42d9-b67a-6d5fe8c5bba9 None admin] RBAC: Authorizing `identity:get_user(user_id=b7f32e659be740308d5f404f4ef015a6)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:17.133646 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edac63-c8ff-42d9-b67a-6d5fe8c5bba9 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:17.135963 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 188/374] 10.222.0.71 () {56 vars in 1177 bytes} [Thu Jul 28 11:04:16 2022] GET /identity/v3/users/b7f32e659be740308d5f404f4ef015a6 => generated 293 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:17.136830 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edac63-c8ff-42d9-b67a-6d5fe8c5bba9 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:17.167119 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e73e50-3277-4ae3-a4ca-0df011534960 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:17.207684 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cf33c-3bf1-4f9e-a309-b8eefa020519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:17.208350 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cf33c-3bf1-4f9e-a309-b8eefa020519 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:17.208613 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cf33c-3bf1-4f9e-a309-b8eefa020519 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:17.208896 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cf33c-3bf1-4f9e-a309-b8eefa020519 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:17.285392 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cf33c-3bf1-4f9e-a309-b8eefa020519 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:17.286916 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cf33c-3bf1-4f9e-a309-b8eefa020519 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:17.324695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:17.384685 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edac63-c8ff-42d9-b67a-6d5fe8c5bba9 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:17.409737 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 187/375] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:17.415193 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cf33c-3bf1-4f9e-a309-b8eefa020519 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:17.448516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b75d0d-c149-44ab-baec-c508cd9616b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:17.449151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b75d0d-c149-44ab-baec-c508cd9616b3 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:17.449429 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b75d0d-c149-44ab-baec-c508cd9616b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:17.449702 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b75d0d-c149-44ab-baec-c508cd9616b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:17.450491 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b75d0d-c149-44ab-baec-c508cd9616b3 None admin] RBAC: Adding query filter params (group.id=dc732aa2652641d99c127014d8a881fb, role.id=e1248e4ba8a34052820e6bd72cdd8b72, scope.project.id=638dc1c8e7a34375b96fb45f061210f0) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:17.450798 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b75d0d-c149-44ab-baec-c508cd9616b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:17.452347 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b75d0d-c149-44ab-baec-c508cd9616b3 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:17.465088 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 189/376] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Jul 28 11:04:17 2022] GET /identity/v3/role_assignments?group.id=dc732aa2652641d99c127014d8a881fb&scope.project.id=638dc1c8e7a34375b96fb45f061210f0&role.id=e1248e4ba8a34052820e6bd72cdd8b72 => generated 260 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:17.466512 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87f731-d9a9-4984-bf64-82d03eddb6af None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:17.466800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87f731-d9a9-4984-bf64-82d03eddb6af None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:17.467077 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87f731-d9a9-4984-bf64-82d03eddb6af None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:17.469588 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 190/377] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:17.469741 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87f731-d9a9-4984-bf64-82d03eddb6af None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:17.510026 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:17.596694 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cf33c-3bf1-4f9e-a309-b8eefa020519 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:17.639399 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716fe46-9d2f-45ab-b4a4-ded15d516520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:17.640392 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716fe46-9d2f-45ab-b4a4-ded15d516520 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:17.640909 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716fe46-9d2f-45ab-b4a4-ded15d516520 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:17.641383 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716fe46-9d2f-45ab-b4a4-ded15d516520 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:17.642481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716fe46-9d2f-45ab-b4a4-ded15d516520 None admin] RBAC: Adding query filter params (role.id=c29fdaefa55648b582d687cc5541fb3e, user.id=b7f32e659be740308d5f404f4ef015a6, scope.system=all) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:17.643301 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716fe46-9d2f-45ab-b4a4-ded15d516520 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:17.645080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716fe46-9d2f-45ab-b4a4-ded15d516520 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:17.648877 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:17.665461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87f731-d9a9-4984-bf64-82d03eddb6af None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:17.669549 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 188/378] 10.222.0.71 () {56 vars in 1308 bytes} [Thu Jul 28 11:04:17 2022] GET /identity/v3/role_assignments?user.id=b7f32e659be740308d5f404f4ef015a6&scope.system=all&role.id=c29fdaefa55648b582d687cc5541fb3e => generated 510 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:17.671131 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616471e3-6935-4398-9161-8e442b8d6cbc None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:17.671653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616471e3-6935-4398-9161-8e442b8d6cbc None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:17.672169 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616471e3-6935-4398-9161-8e442b8d6cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:17.698314 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-616471e3-6935-4398-9161-8e442b8d6cbc None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:17.699606 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-616471e3-6935-4398-9161-8e442b8d6cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:17.740981 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7a9a2-eeb7-4978-b024-4f0258915b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:17.745917 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7a9a2-eeb7-4978-b024-4f0258915b3f None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:17.745917 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7a9a2-eeb7-4978-b024-4f0258915b3f None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:17.746515 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7a9a2-eeb7-4978-b024-4f0258915b3f None admin] PATH_INFO: `/v3/projects/584d842f145544c78397d7b263b77dae` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:17.754916 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7a9a2-eeb7-4978-b024-4f0258915b3f None admin] RBAC: Authorizing `identity:get_project(project_id=584d842f145544c78397d7b263b77dae)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:17.756477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7a9a2-eeb7-4978-b024-4f0258915b3f None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:17.758424 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 191/379] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:17 2022] GET /identity/v3/projects/584d842f145544c78397d7b263b77dae => generated 344 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:17.765446 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7a9a2-eeb7-4978-b024-4f0258915b3f None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:17.863543 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 189/380] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:17.888347 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616471e3-6935-4398-9161-8e442b8d6cbc None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:17.902244 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:17.937349 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7a9a2-eeb7-4978-b024-4f0258915b3f None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:17.989634 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22edf5a-93aa-47fd-ac27-204e33c3173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:17.990213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22edf5a-93aa-47fd-ac27-204e33c3173d None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:17.990503 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22edf5a-93aa-47fd-ac27-204e33c3173d None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:17.990788 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22edf5a-93aa-47fd-ac27-204e33c3173d None admin] PATH_INFO: `/v3/groups/b0b9f0f82836495ba6ab061b8f5e55a5` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:18.004068 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22edf5a-93aa-47fd-ac27-204e33c3173d None admin] RBAC: Authorizing `identity:get_group(group_id=b0b9f0f82836495ba6ab061b8f5e55a5)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:18.005595 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22edf5a-93aa-47fd-ac27-204e33c3173d None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:18.007768 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 192/381] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Jul 28 11:04:17 2022] GET /identity/v3/groups/b0b9f0f82836495ba6ab061b8f5e55a5 => generated 229 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:18.031302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22edf5a-93aa-47fd-ac27-204e33c3173d None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:18.058875 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616471e3-6935-4398-9161-8e442b8d6cbc None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:18.091619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:18.103275 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631d79a-7986-40c4-88e1-aaaa5c1dbbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:18.104093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631d79a-7986-40c4-88e1-aaaa5c1dbbf5 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:18.104450 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631d79a-7986-40c4-88e1-aaaa5c1dbbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:18.104795 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631d79a-7986-40c4-88e1-aaaa5c1dbbf5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:18.119000 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631d79a-7986-40c4-88e1-aaaa5c1dbbf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:18.124567 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-4631d79a-7986-40c4-88e1-aaaa5c1dbbf5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:18.124567 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:18.124567 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:18.124567 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:18.124567 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:18.124567 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:18.124567 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:18.124567 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:18.124567 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:18.124567 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:18.124567 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:18.124567 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:18.124567 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:18.124567 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:18.124567 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:18.124567 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:18.125646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:18.125646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:18.125646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:18.125646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:18.125646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:18.125646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:18.125646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:18.125646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:18.125646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:18.125646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:18.125646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:18.125646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:18.125646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:18.125646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:18.125646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:18.125646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:18.126605 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:18.126605 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:18.126605 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:18.126605 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:18.126605 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:18.126605 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:18.126605 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:18.126605 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:18.126605 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:18.126605 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:18.126605 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:18.126605 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:18.133471 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 190/382] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:18.134949 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631d79a-7986-40c4-88e1-aaaa5c1dbbf5 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:18.251487 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631d79a-7986-40c4-88e1-aaaa5c1dbbf5 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:18.277308 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22edf5a-93aa-47fd-ac27-204e33c3173d None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:18.300172 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d87ab-8ebb-4637-97a8-ee6723103b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:18.300970 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d87ab-8ebb-4637-97a8-ee6723103b23 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:18.301320 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d87ab-8ebb-4637-97a8-ee6723103b23 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:18.301705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d87ab-8ebb-4637-97a8-ee6723103b23 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:18.302514 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d87ab-8ebb-4637-97a8-ee6723103b23 None admin] RBAC: Adding query filter params (name=member) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:18.302890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d87ab-8ebb-4637-97a8-ee6723103b23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:18.304485 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d87ab-8ebb-4637-97a8-ee6723103b23 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:18.319373 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 191/383] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:04:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:18.324988 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d87ab-8ebb-4637-97a8-ee6723103b23 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:18.347705 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340aefd5-7bec-4b8f-8a4e-62589c36ab16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:18.348643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340aefd5-7bec-4b8f-8a4e-62589c36ab16 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:18.349092 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340aefd5-7bec-4b8f-8a4e-62589c36ab16 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:18.349512 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340aefd5-7bec-4b8f-8a4e-62589c36ab16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:18.350647 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340aefd5-7bec-4b8f-8a4e-62589c36ab16 None admin] RBAC: Adding query filter params (group.id=b0b9f0f82836495ba6ab061b8f5e55a5, role.id=f2a8452a65264f9ea10467160b1bd735, scope.project.id=584d842f145544c78397d7b263b77dae) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:18.351107 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340aefd5-7bec-4b8f-8a4e-62589c36ab16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:18.353383 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340aefd5-7bec-4b8f-8a4e-62589c36ab16 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:18.364667 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 193/384] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Jul 28 11:04:18 2022] GET /identity/v3/role_assignments?group.id=b0b9f0f82836495ba6ab061b8f5e55a5&scope.project.id=584d842f145544c78397d7b263b77dae&role.id=f2a8452a65264f9ea10467160b1bd735 => generated 260 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:18.388564 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:18.469724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d87ab-8ebb-4637-97a8-ee6723103b23 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:18.510197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55903e3-693c-4072-af98-22e2b041240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:18.511072 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55903e3-693c-4072-af98-22e2b041240f None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:18.511396 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55903e3-693c-4072-af98-22e2b041240f None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:18.511675 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55903e3-693c-4072-af98-22e2b041240f None admin] PATH_INFO: `/v3/groups/dc732aa2652641d99c127014d8a881fb` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:18.512875 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55903e3-693c-4072-af98-22e2b041240f None admin] RBAC: Authorizing `identity:get_group(group_id=dc732aa2652641d99c127014d8a881fb)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:18.514367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55903e3-693c-4072-af98-22e2b041240f None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:18.523664 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 192/385] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Jul 28 11:04:18 2022] GET /identity/v3/groups/dc732aa2652641d99c127014d8a881fb => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:18.524323 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340aefd5-7bec-4b8f-8a4e-62589c36ab16 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:18.548627 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:18.662654 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340aefd5-7bec-4b8f-8a4e-62589c36ab16 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:18.708414 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f60d7-d5f3-4cd4-9b44-82c4c76a373b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:18.709423 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f60d7-d5f3-4cd4-9b44-82c4c76a373b None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:18.709889 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f60d7-d5f3-4cd4-9b44-82c4c76a373b None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:18.710352 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f60d7-d5f3-4cd4-9b44-82c4c76a373b None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:18.712461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f60d7-d5f3-4cd4-9b44-82c4c76a373b None admin] RBAC: Authorizing `identity:get_project(project_id=19ee209183e74289b7ddcfce7e067a7a)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:18.714193 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f60d7-d5f3-4cd4-9b44-82c4c76a373b None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:18.721982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 194/386] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:18 2022] GET /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:18.723936 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55903e3-693c-4072-af98-22e2b041240f None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:18.850898 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55903e3-693c-4072-af98-22e2b041240f None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:18.866529 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:18.889214 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f711ec4-c945-432a-aa06-4f9b8f7f9092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:18.889920 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f711ec4-c945-432a-aa06-4f9b8f7f9092 None admin] REQUEST_METHOD: `PUT` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:18.890201 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f711ec4-c945-432a-aa06-4f9b8f7f9092 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:18.890479 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f711ec4-c945-432a-aa06-4f9b8f7f9092 None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a/groups/dc732aa2652641d99c127014d8a881fb/roles/05bb46007d644829b12b0d4ded0bd8d2` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:18.892521 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f711ec4-c945-432a-aa06-4f9b8f7f9092 None admin] RBAC: Authorizing `identity:create_grant(project_id=19ee209183e74289b7ddcfce7e067a7a, group_id=dc732aa2652641d99c127014d8a881fb, role_id=05bb46007d644829b12b0d4ded0bd8d2)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:18.893995 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f711ec4-c945-432a-aa06-4f9b8f7f9092 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:18.914042 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 193/387] 10.222.0.71 () {58 vars in 1442 bytes} [Thu Jul 28 11:04:18 2022] PUT /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a/groups/dc732aa2652641d99c127014d8a881fb/roles/05bb46007d644829b12b0d4ded0bd8d2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:04:18.940924 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37ce32-8905-4c42-b9bf-cfeddac9b31c None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:18.941424 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37ce32-8905-4c42-b9bf-cfeddac9b31c None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:18.941496 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37ce32-8905-4c42-b9bf-cfeddac9b31c None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:18.943013 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 195/388] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:18.949612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535f5c8-2827-4bcd-9db5-dba8407c08de None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:18.949906 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535f5c8-2827-4bcd-9db5-dba8407c08de None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:18.950164 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535f5c8-2827-4bcd-9db5-dba8407c08de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:18.971140 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-5535f5c8-2827-4bcd-9db5-dba8407c08de None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:18.974683 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-5535f5c8-2827-4bcd-9db5-dba8407c08de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:19.059758 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 194/389] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:19.099535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37ce32-8905-4c42-b9bf-cfeddac9b31c None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:19.251859 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:19.274730 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37ce32-8905-4c42-b9bf-cfeddac9b31c None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:19.331444 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942e48a-33fe-4594-8dee-80ade9a98651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:19.332175 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942e48a-33fe-4594-8dee-80ade9a98651 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:19.332510 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942e48a-33fe-4594-8dee-80ade9a98651 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:19.332840 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942e48a-33fe-4594-8dee-80ade9a98651 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:19.347428 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942e48a-33fe-4594-8dee-80ade9a98651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:19.352751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-1942e48a-33fe-4594-8dee-80ade9a98651 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:04:19.352751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:19.352751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:19.352751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:19.352751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:19.352751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:19.352751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:19.352751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:19.352751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:19.352751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:19.352751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:19.352751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:19.352751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:19.352751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:19.352751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:19.352751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:19.354940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:19.354940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:19.354940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:19.354940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:19.354940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:19.354940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:19.354940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:19.354940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:19.354940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:19.354940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:19.354940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:19.354940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:19.354940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:19.354940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:19.354940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:19.354940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:19.356868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:19.356868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:19.356868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:19.356868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:19.356868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:19.356868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:19.356868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:19.356868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:19.356868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:19.356868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:19.356868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:04:19.356868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:19.356868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 196/390] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:04:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:19.363296 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535f5c8-2827-4bcd-9db5-dba8407c08de None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:19.512246 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535f5c8-2827-4bcd-9db5-dba8407c08de None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:19.520426 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:19.564879 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd775003-0239-411b-b3f4-40bfe365ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:19.565516 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd775003-0239-411b-b3f4-40bfe365ff28 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:19.565800 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd775003-0239-411b-b3f4-40bfe365ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:19.566082 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd775003-0239-411b-b3f4-40bfe365ff28 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:19.566818 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd775003-0239-411b-b3f4-40bfe365ff28 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:19.567131 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd775003-0239-411b-b3f4-40bfe365ff28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:19.568553 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd775003-0239-411b-b3f4-40bfe365ff28 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:19.579203 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 195/391] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:19.586336 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942e48a-33fe-4594-8dee-80ade9a98651 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:19.833101 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942e48a-33fe-4594-8dee-80ade9a98651 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:19.908356 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3d6ac-6cc0-45e9-b923-bc4f0cf9a2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:19.909903 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3d6ac-6cc0-45e9-b923-bc4f0cf9a2ee None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:19.910649 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3d6ac-6cc0-45e9-b923-bc4f0cf9a2ee None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:19.915481 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3d6ac-6cc0-45e9-b923-bc4f0cf9a2ee None admin] PATH_INFO: `/v3/groups/dc732aa2652641d99c127014d8a881fb` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:19.917850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3d6ac-6cc0-45e9-b923-bc4f0cf9a2ee None admin] RBAC: Authorizing `identity:get_group(group_id=dc732aa2652641d99c127014d8a881fb)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:19.920726 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3d6ac-6cc0-45e9-b923-bc4f0cf9a2ee None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:19.924311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 197/392] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Jul 28 11:04:19 2022] GET /identity/v3/groups/dc732aa2652641d99c127014d8a881fb => generated 226 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:19.930137 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd775003-0239-411b-b3f4-40bfe365ff28 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:19.966085 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3af88-320f-4e59-a553-8e4d8e31a08a None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:19.967539 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3af88-320f-4e59-a553-8e4d8e31a08a None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:19.968294 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3af88-320f-4e59-a553-8e4d8e31a08a None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:19.971546 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 198/393] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:19.980117 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f314d-e922-4f78-bb92-9a08615f7952 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:19.981001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f314d-e922-4f78-bb92-9a08615f7952 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:19.981755 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f314d-e922-4f78-bb92-9a08615f7952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:20.032955 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-950f314d-e922-4f78-bb92-9a08615f7952 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:20.035412 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-950f314d-e922-4f78-bb92-9a08615f7952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:20.050486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd775003-0239-411b-b3f4-40bfe365ff28 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:20.059301 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:20.089142 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804af7b-656d-4234-9403-6567fa58fdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:20.089747 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804af7b-656d-4234-9403-6567fa58fdb8 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:20.090032 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804af7b-656d-4234-9403-6567fa58fdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:20.090308 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804af7b-656d-4234-9403-6567fa58fdb8 None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:20.095294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804af7b-656d-4234-9403-6567fa58fdb8 None admin] RBAC: Authorizing `identity:get_project(project_id=19ee209183e74289b7ddcfce7e067a7a)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:20.095294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804af7b-656d-4234-9403-6567fa58fdb8 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:20.095294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 196/394] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:19 2022] GET /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:20.100593 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804af7b-656d-4234-9403-6567fa58fdb8 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:20.147683 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:20.218635 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804af7b-656d-4234-9403-6567fa58fdb8 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:20.256626 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c4334-3e39-487a-9160-2b858545036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:20.257357 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c4334-3e39-487a-9160-2b858545036b None admin] REQUEST_METHOD: `PUT` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:20.258197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c4334-3e39-487a-9160-2b858545036b None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:20.258466 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c4334-3e39-487a-9160-2b858545036b None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a/groups/dc732aa2652641d99c127014d8a881fb/roles/e1248e4ba8a34052820e6bd72cdd8b72` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:20.261287 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c4334-3e39-487a-9160-2b858545036b None admin] RBAC: Authorizing `identity:create_grant(project_id=19ee209183e74289b7ddcfce7e067a7a, group_id=dc732aa2652641d99c127014d8a881fb, role_id=e1248e4ba8a34052820e6bd72cdd8b72)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:20.262807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c4334-3e39-487a-9160-2b858545036b None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:20.283529 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 197/395] 10.222.0.71 () {58 vars in 1442 bytes} [Thu Jul 28 11:04:20 2022] PUT /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a/groups/dc732aa2652641d99c127014d8a881fb/roles/e1248e4ba8a34052820e6bd72cdd8b72 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:04:20.306758 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 199/396] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:04:20.379632 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c4334-3e39-487a-9160-2b858545036b None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:20.505370 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:20.513225 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c4334-3e39-487a-9160-2b858545036b None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:20.550950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d3df2-3553-4970-b907-5526a383b080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:20.551725 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d3df2-3553-4970-b907-5526a383b080 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:20.552009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d3df2-3553-4970-b907-5526a383b080 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:20.552283 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d3df2-3553-4970-b907-5526a383b080 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:20.563849 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d3df2-3553-4970-b907-5526a383b080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:20.568829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-d64d3df2-3553-4970-b907-5526a383b080 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:20.568829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:20.568829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:20.568829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:20.568829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:20.568829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:20.568829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:20.568829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:20.568829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:20.568829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:20.568829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:20.568829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:20.568829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:20.568829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:20.568829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:20.568829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:20.571682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:20.571682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:20.571682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:20.571682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:20.571682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:20.571682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:20.571682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:20.571682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:20.571682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:20.571682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:20.571682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:20.571682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:20.571682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:20.571682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:20.571682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:20.571682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:20.574122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:20.574122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:20.574122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:20.574122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:20.574122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:20.574122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:20.574122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:20.574122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:20.574122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:20.574122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:20.574122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:20.574122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:20.574122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 198/397] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:20.588507 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f314d-e922-4f78-bb92-9a08615f7952 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:20.633306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe474d-bce0-4b1c-a035-98732e98d3bd None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:20.633489 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe474d-bce0-4b1c-a035-98732e98d3bd None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:20.633773 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe474d-bce0-4b1c-a035-98732e98d3bd None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:20.636514 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 199/398] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:20.641795 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad022e-14fd-4319-aa5f-2fe51f49b0fb None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:20.642255 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad022e-14fd-4319-aa5f-2fe51f49b0fb None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:20.642675 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad022e-14fd-4319-aa5f-2fe51f49b0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:20.664851 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-91ad022e-14fd-4319-aa5f-2fe51f49b0fb None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:20.666804 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-91ad022e-14fd-4319-aa5f-2fe51f49b0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:20.749414 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 200/399] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:20.763436 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f314d-e922-4f78-bb92-9a08615f7952 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:20.786596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad022e-14fd-4319-aa5f-2fe51f49b0fb None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:20.829615 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fd29f-1ff0-461e-83cd-3f4ed66a8ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:20.830522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fd29f-1ff0-461e-83cd-3f4ed66a8ffd None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:20.831015 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fd29f-1ff0-461e-83cd-3f4ed66a8ffd None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:20.831453 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fd29f-1ff0-461e-83cd-3f4ed66a8ffd None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:20.833223 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fd29f-1ff0-461e-83cd-3f4ed66a8ffd None admin] RBAC: Adding query filter params (name=member) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:20.835338 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fd29f-1ff0-461e-83cd-3f4ed66a8ffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:20.837427 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fd29f-1ff0-461e-83cd-3f4ed66a8ffd None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:20.852875 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 200/400] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:04:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:20.863876 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fd29f-1ff0-461e-83cd-3f4ed66a8ffd None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:20.869347 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:20.989551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fd29f-1ff0-461e-83cd-3f4ed66a8ffd None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:21.030909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23069b8d-3d2f-4c1d-a7cf-4eebaa3287c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:21.031918 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23069b8d-3d2f-4c1d-a7cf-4eebaa3287c0 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:21.032706 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23069b8d-3d2f-4c1d-a7cf-4eebaa3287c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:21.033162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23069b8d-3d2f-4c1d-a7cf-4eebaa3287c0 None admin] PATH_INFO: `/v3/groups/dc732aa2652641d99c127014d8a881fb` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:21.034864 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23069b8d-3d2f-4c1d-a7cf-4eebaa3287c0 None admin] RBAC: Authorizing `identity:get_group(group_id=dc732aa2652641d99c127014d8a881fb)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:21.037281 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23069b8d-3d2f-4c1d-a7cf-4eebaa3287c0 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:21.039936 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 201/401] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Jul 28 11:04:20 2022] GET /identity/v3/groups/dc732aa2652641d99c127014d8a881fb => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:21.047479 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:21.049800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23069b8d-3d2f-4c1d-a7cf-4eebaa3287c0 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:21.087921 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad022e-14fd-4319-aa5f-2fe51f49b0fb None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:21.183655 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:21.184318 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1d849-9037-48ee-8fa8-dd0940dc55b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:21.187200 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1d849-9037-48ee-8fa8-dd0940dc55b9 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:21.187658 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1d849-9037-48ee-8fa8-dd0940dc55b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:21.188078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1d849-9037-48ee-8fa8-dd0940dc55b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:21.214332 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1d849-9037-48ee-8fa8-dd0940dc55b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:21.220057 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-b4b1d849-9037-48ee-8fa8-dd0940dc55b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:04:21.220057 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:21.220057 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:21.220057 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:21.220057 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:21.220057 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:21.220057 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:21.220057 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:21.220057 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:21.220057 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:21.220057 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:21.220057 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:21.220057 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:21.220057 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:21.220057 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:21.220057 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:21.221103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:21.221103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:21.221103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:21.221103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:21.221103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:21.221103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:21.221103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:21.221103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:21.221103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:21.221103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:21.221103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:21.221103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:21.221103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:21.221103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:21.221103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:21.221103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:21.222105 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:21.222105 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:21.222105 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:21.222105 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:21.222105 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:21.222105 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:21.222105 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:21.222105 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:21.222105 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:21.222105 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:21.222105 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:04:21.222105 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:21.229439 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 201/402] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:04:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 443 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:04:21.233578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23069b8d-3d2f-4c1d-a7cf-4eebaa3287c0 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:21.236951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1d849-9037-48ee-8fa8-dd0940dc55b9 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:21.270205 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa50cbc-a7d7-4187-b3ed-0a800fd35916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:21.271076 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa50cbc-a7d7-4187-b3ed-0a800fd35916 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:21.271529 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa50cbc-a7d7-4187-b3ed-0a800fd35916 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:21.271970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa50cbc-a7d7-4187-b3ed-0a800fd35916 None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:21.273357 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa50cbc-a7d7-4187-b3ed-0a800fd35916 None admin] RBAC: Authorizing `identity:get_project(project_id=638dc1c8e7a34375b96fb45f061210f0)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:21.274939 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa50cbc-a7d7-4187-b3ed-0a800fd35916 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:21.277085 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 202/403] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:21 2022] GET /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:21.282748 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa50cbc-a7d7-4187-b3ed-0a800fd35916 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:21.399952 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa50cbc-a7d7-4187-b3ed-0a800fd35916 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:21.440894 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739831d2-616c-4faa-916d-a610f1e459ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:21.441952 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739831d2-616c-4faa-916d-a610f1e459ff None admin] REQUEST_METHOD: `PUT` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:21.442436 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739831d2-616c-4faa-916d-a610f1e459ff None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:21.442944 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739831d2-616c-4faa-916d-a610f1e459ff None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0/groups/dc732aa2652641d99c127014d8a881fb/roles/05bb46007d644829b12b0d4ded0bd8d2` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:21.448745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739831d2-616c-4faa-916d-a610f1e459ff None admin] RBAC: Authorizing `identity:create_grant(project_id=638dc1c8e7a34375b96fb45f061210f0, group_id=dc732aa2652641d99c127014d8a881fb, role_id=05bb46007d644829b12b0d4ded0bd8d2)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:21.450503 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739831d2-616c-4faa-916d-a610f1e459ff None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:21.469265 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 203/404] 10.222.0.71 () {58 vars in 1442 bytes} [Thu Jul 28 11:04:21 2022] PUT /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0/groups/dc732aa2652641d99c127014d8a881fb/roles/05bb46007d644829b12b0d4ded0bd8d2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 11:04:21.470575 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:21.488875 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1d849-9037-48ee-8fa8-dd0940dc55b9 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:21.560599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03bc0d-1eee-46d6-ad67-c825f70f4dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:21.561258 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03bc0d-1eee-46d6-ad67-c825f70f4dcd None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:21.561541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03bc0d-1eee-46d6-ad67-c825f70f4dcd None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:21.561816 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03bc0d-1eee-46d6-ad67-c825f70f4dcd None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:21.562562 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03bc0d-1eee-46d6-ad67-c825f70f4dcd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:21.562869 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03bc0d-1eee-46d6-ad67-c825f70f4dcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:21.564344 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03bc0d-1eee-46d6-ad67-c825f70f4dcd None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:21.580131 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 202/405] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:21.585470 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739831d2-616c-4faa-916d-a610f1e459ff None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:21.720146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739831d2-616c-4faa-916d-a610f1e459ff None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:21.759297 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91de00-6bf1-4872-a909-e88b18bbc74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:21.759989 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91de00-6bf1-4872-a909-e88b18bbc74c None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:21.760269 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91de00-6bf1-4872-a909-e88b18bbc74c None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:21.760546 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91de00-6bf1-4872-a909-e88b18bbc74c None admin] PATH_INFO: `/v3/groups/dc732aa2652641d99c127014d8a881fb` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:21.762130 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91de00-6bf1-4872-a909-e88b18bbc74c None admin] RBAC: Authorizing `identity:get_group(group_id=dc732aa2652641d99c127014d8a881fb)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:21.764003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91de00-6bf1-4872-a909-e88b18bbc74c None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:21.766165 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 204/406] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Jul 28 11:04:21 2022] GET /identity/v3/groups/dc732aa2652641d99c127014d8a881fb => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:21.772510 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03bc0d-1eee-46d6-ad67-c825f70f4dcd None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:21.787154 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:21.899633 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03bc0d-1eee-46d6-ad67-c825f70f4dcd None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:21.938220 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e92cd3-01f3-4e04-8858-1934e97cbb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:21.940573 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a824f4-2a83-4d76-ad98-d02323b475f5 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:21.941178 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a824f4-2a83-4d76-ad98-d02323b475f5 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:21.941653 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a824f4-2a83-4d76-ad98-d02323b475f5 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:21.943206 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 205/407] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:04:21.943552 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e92cd3-01f3-4e04-8858-1934e97cbb06 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:21.944083 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e92cd3-01f3-4e04-8858-1934e97cbb06 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:21.944536 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e92cd3-01f3-4e04-8858-1934e97cbb06 None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:21.946113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e92cd3-01f3-4e04-8858-1934e97cbb06 None admin] RBAC: Authorizing `identity:get_project(project_id=638dc1c8e7a34375b96fb45f061210f0)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:21.948678 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeed13-71be-4473-b916-c35794ee6f21 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:21.949172 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeed13-71be-4473-b916-c35794ee6f21 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:21.949639 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeed13-71be-4473-b916-c35794ee6f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:21.955429 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e92cd3-01f3-4e04-8858-1934e97cbb06 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:21.967002 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 203/408] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:21 2022] GET /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:21.974225 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-8edeed13-71be-4473-b916-c35794ee6f21 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:21.977365 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-8edeed13-71be-4473-b916-c35794ee6f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:21.982628 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e92cd3-01f3-4e04-8858-1934e97cbb06 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:22.151835 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:22.155203 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:22.161740 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 206/409] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:04:22.190316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e92cd3-01f3-4e04-8858-1934e97cbb06 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:22.226405 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edeed13-71be-4473-b916-c35794ee6f21 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:22.247337 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd5bde-1414-46a7-987f-51806820ffb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:22.248204 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd5bde-1414-46a7-987f-51806820ffb7 None admin] REQUEST_METHOD: `PUT` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:22.248593 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd5bde-1414-46a7-987f-51806820ffb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:22.249039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd5bde-1414-46a7-987f-51806820ffb7 None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0/groups/dc732aa2652641d99c127014d8a881fb/roles/e1248e4ba8a34052820e6bd72cdd8b72` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:22.253442 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd5bde-1414-46a7-987f-51806820ffb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=638dc1c8e7a34375b96fb45f061210f0, group_id=dc732aa2652641d99c127014d8a881fb, role_id=e1248e4ba8a34052820e6bd72cdd8b72)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:22.255930 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd5bde-1414-46a7-987f-51806820ffb7 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:22.281861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 204/410] 10.222.0.71 () {58 vars in 1442 bytes} [Thu Jul 28 11:04:21 2022] PUT /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0/groups/dc732aa2652641d99c127014d8a881fb/roles/e1248e4ba8a34052820e6bd72cdd8b72 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:04:22.364776 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edeed13-71be-4473-b916-c35794ee6f21 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:22.405445 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aac8ad-c1f3-446b-a098-e3bdc156a693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:22.406134 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aac8ad-c1f3-446b-a098-e3bdc156a693 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:22.406537 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aac8ad-c1f3-446b-a098-e3bdc156a693 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:22.406890 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aac8ad-c1f3-446b-a098-e3bdc156a693 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:22.420419 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aac8ad-c1f3-446b-a098-e3bdc156a693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:22.426023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-d8aac8ad-c1f3-446b-a098-e3bdc156a693 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:04:22.426023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:22.426023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:22.426023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:22.426023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:22.426023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:22.426023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:22.426023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:22.426023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:22.426023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:22.426023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:22.426023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:22.426023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:22.426023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:22.426023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:22.426023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:22.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:22.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:22.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:22.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:22.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:22.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:22.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:22.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:22.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:22.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:22.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:22.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:22.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:22.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:22.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:22.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:22.428036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:22.428036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:22.428036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:22.428036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:22.428036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:22.428036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:22.428036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:22.428036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:22.428036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:22.428036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:22.428036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:04:22.428036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:22.428036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 207/411] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Jul 28 11:04:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:04:22.436908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd5bde-1414-46a7-987f-51806820ffb7 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:22.472337 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a9a48-5a13-43b9-8cbc-abf132f58077 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:22.472678 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a9a48-5a13-43b9-8cbc-abf132f58077 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:22.473331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a9a48-5a13-43b9-8cbc-abf132f58077 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:22.474685 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 208/412] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:22.480263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bef14d-744f-4568-b9a2-2ca198fe7d96 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:22.480753 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bef14d-744f-4568-b9a2-2ca198fe7d96 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:22.480872 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bef14d-744f-4568-b9a2-2ca198fe7d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:22.527125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-95bef14d-744f-4568-b9a2-2ca198fe7d96 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:22.527125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-95bef14d-744f-4568-b9a2-2ca198fe7d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:22.604301 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:22.631379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 209/413] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:22.650268 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bef14d-744f-4568-b9a2-2ca198fe7d96 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:22.701100 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd5bde-1414-46a7-987f-51806820ffb7 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:22.764836 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b51ca-4119-4ca0-9a37-854aeb010a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:22.765845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b51ca-4119-4ca0-9a37-854aeb010a72 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:22.767615 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b51ca-4119-4ca0-9a37-854aeb010a72 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:22.768050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b51ca-4119-4ca0-9a37-854aeb010a72 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:22.769396 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b51ca-4119-4ca0-9a37-854aeb010a72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:22.771314 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b51ca-4119-4ca0-9a37-854aeb010a72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:22.772879 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b51ca-4119-4ca0-9a37-854aeb010a72 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:22.777216 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:22.792777 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 205/414] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:22.798391 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b51ca-4119-4ca0-9a37-854aeb010a72 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:22.837972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bef14d-744f-4568-b9a2-2ca198fe7d96 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:22.907774 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfcb32-b5ad-4d21-96ef-6329cafc5c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:22.908457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfcb32-b5ad-4d21-96ef-6329cafc5c1a None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:22.908746 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfcb32-b5ad-4d21-96ef-6329cafc5c1a None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:22.909025 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfcb32-b5ad-4d21-96ef-6329cafc5c1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:22.934611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfcb32-b5ad-4d21-96ef-6329cafc5c1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:22.941745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-10dfcb32-b5ad-4d21-96ef-6329cafc5c1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:22.941745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:22.941745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:22.941745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:22.941745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:22.941745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:22.941745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:22.941745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:22.941745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:22.941745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:22.941745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:22.941745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:22.941745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:22.941745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:22.941745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:22.941745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:22.942756 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:22.942756 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:22.942756 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:22.942756 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:22.942756 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:22.942756 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:22.942756 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:22.942756 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:22.942756 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:22.942756 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:22.942756 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:22.942756 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:22.942756 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:22.942756 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:22.942756 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:22.942756 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:22.943611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:22.943611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:22.943611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:22.943611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:22.943611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:22.943611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:22.943611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:22.943611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:22.943611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:22.943611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:22.943611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:22.943611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:22.946988 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 210/415] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:22.953126 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfcb32-b5ad-4d21-96ef-6329cafc5c1a None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:22.996241 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b51ca-4119-4ca0-9a37-854aeb010a72 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:23.057395 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a523357-3085-4bae-ae07-8a1e09a24d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:23.057395 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a523357-3085-4bae-ae07-8a1e09a24d59 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:23.057724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a523357-3085-4bae-ae07-8a1e09a24d59 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:23.057853 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a523357-3085-4bae-ae07-8a1e09a24d59 None admin] PATH_INFO: `/v3/groups/b0b9f0f82836495ba6ab061b8f5e55a5` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:23.064045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a523357-3085-4bae-ae07-8a1e09a24d59 None admin] RBAC: Authorizing `identity:get_group(group_id=b0b9f0f82836495ba6ab061b8f5e55a5)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:23.065602 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a523357-3085-4bae-ae07-8a1e09a24d59 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:23.068404 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 206/416] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Jul 28 11:04:22 2022] GET /identity/v3/groups/b0b9f0f82836495ba6ab061b8f5e55a5 => generated 229 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:23.075953 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a523357-3085-4bae-ae07-8a1e09a24d59 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:23.091935 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:23.200222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:23.205551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfcb32-b5ad-4d21-96ef-6329cafc5c1a None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:23.250670 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47703d-da05-477a-a07a-1b0cf167e309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:23.251345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47703d-da05-477a-a07a-1b0cf167e309 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:23.251637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47703d-da05-477a-a07a-1b0cf167e309 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:23.251914 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47703d-da05-477a-a07a-1b0cf167e309 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:23.253190 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47703d-da05-477a-a07a-1b0cf167e309 None admin] RBAC: Adding query filter params (name=member) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:23.253505 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47703d-da05-477a-a07a-1b0cf167e309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:23.255226 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47703d-da05-477a-a07a-1b0cf167e309 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:23.265709 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a523357-3085-4bae-ae07-8a1e09a24d59 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:23.266326 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 211/417] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:04:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:23.267649 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e7ba9-f18f-46e9-9013-155998c1f3e7 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:23.267944 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e7ba9-f18f-46e9-9013-155998c1f3e7 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:23.268222 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e7ba9-f18f-46e9-9013-155998c1f3e7 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:23.274250 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 212/418] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:23.274966 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e7ba9-f18f-46e9-9013-155998c1f3e7 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:23.304876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4efdca-d455-41c0-9860-22de96453dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:23.305537 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4efdca-d455-41c0-9860-22de96453dfc None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:23.305824 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4efdca-d455-41c0-9860-22de96453dfc None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:23.306106 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4efdca-d455-41c0-9860-22de96453dfc None admin] PATH_INFO: `/v3/projects/584d842f145544c78397d7b263b77dae` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:23.307349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4efdca-d455-41c0-9860-22de96453dfc None admin] RBAC: Authorizing `identity:get_project(project_id=584d842f145544c78397d7b263b77dae)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:23.308830 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4efdca-d455-41c0-9860-22de96453dfc None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:23.310849 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 207/419] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:23 2022] GET /identity/v3/projects/584d842f145544c78397d7b263b77dae => generated 344 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:23.316291 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae6718-1664-4cb6-b824-a26bb808aadc None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:23.316648 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae6718-1664-4cb6-b824-a26bb808aadc None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:23.316936 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae6718-1664-4cb6-b824-a26bb808aadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:23.337269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-adae6718-1664-4cb6-b824-a26bb808aadc None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:23.338484 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-adae6718-1664-4cb6-b824-a26bb808aadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:23.400727 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e7ba9-f18f-46e9-9013-155998c1f3e7 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:23.413158 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:23.416591 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 208/420] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:23.417465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae6718-1664-4cb6-b824-a26bb808aadc None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:23.462354 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e489ad-db0e-4e49-b99c-12f0524730c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:23.463012 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e489ad-db0e-4e49-b99c-12f0524730c4 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:23.463317 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e489ad-db0e-4e49-b99c-12f0524730c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:23.463603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e489ad-db0e-4e49-b99c-12f0524730c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:23.498876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:23.557890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae6718-1664-4cb6-b824-a26bb808aadc None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:23.561115 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e489ad-db0e-4e49-b99c-12f0524730c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:23.562633 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e489ad-db0e-4e49-b99c-12f0524730c4 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:23.606614 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb861f1b-639f-4c6f-88f0-f372a49c8a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:23.607327 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb861f1b-639f-4c6f-88f0-f372a49c8a80 None admin] REQUEST_METHOD: `PUT` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:23.607611 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb861f1b-639f-4c6f-88f0-f372a49c8a80 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:23.608062 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb861f1b-639f-4c6f-88f0-f372a49c8a80 None admin] PATH_INFO: `/v3/projects/584d842f145544c78397d7b263b77dae/groups/b0b9f0f82836495ba6ab061b8f5e55a5/roles/f2a8452a65264f9ea10467160b1bd735` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:23.611301 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb861f1b-639f-4c6f-88f0-f372a49c8a80 None admin] RBAC: Authorizing `identity:create_grant(project_id=584d842f145544c78397d7b263b77dae, group_id=b0b9f0f82836495ba6ab061b8f5e55a5, role_id=f2a8452a65264f9ea10467160b1bd735)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:23.613562 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb861f1b-639f-4c6f-88f0-f372a49c8a80 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:23.630416 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 209/421] 10.222.0.71 () {58 vars in 1442 bytes} [Thu Jul 28 11:04:23 2022] PUT /identity/v3/projects/584d842f145544c78397d7b263b77dae/groups/b0b9f0f82836495ba6ab061b8f5e55a5/roles/f2a8452a65264f9ea10467160b1bd735 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:04:23.631924 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb861f1b-639f-4c6f-88f0-f372a49c8a80 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:23.733017 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 213/422] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:23.739125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e489ad-db0e-4e49-b99c-12f0524730c4 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:23.764195 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:23.775660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb861f1b-639f-4c6f-88f0-f372a49c8a80 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:23.807419 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:23.826672 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ecd27-0aaa-49fe-91e0-16e8643f8d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:23.827703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ecd27-0aaa-49fe-91e0-16e8643f8d19 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:23.828134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ecd27-0aaa-49fe-91e0-16e8643f8d19 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:23.828749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ecd27-0aaa-49fe-91e0-16e8643f8d19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:23.844071 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ecd27-0aaa-49fe-91e0-16e8643f8d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:23.850665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-924ecd27-0aaa-49fe-91e0-16e8643f8d19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:04:23.850665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:23.850665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:23.850665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:23.850665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:23.850665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:23.850665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:23.850665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:23.850665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:23.850665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:23.850665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:23.850665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:23.850665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:23.850665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:23.850665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:23.850665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:23.852289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:23.852289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:23.852289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:23.852289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:23.852289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:23.852289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:23.852289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:23.852289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:23.852289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:23.852289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:23.852289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:23.852289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:23.852289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:23.852289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:23.852289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:23.852289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:23.853079 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:23.853079 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:23.853079 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:23.853079 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:23.853079 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:23.853079 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:23.853079 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:23.853079 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:23.853079 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:23.853079 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:23.853079 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:04:23.853079 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:23.853671 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 210/423] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:04:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:23.860091 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ecd27-0aaa-49fe-91e0-16e8643f8d19 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:23.989277 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e489ad-db0e-4e49-b99c-12f0524730c4 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:23.992666 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ecd27-0aaa-49fe-91e0-16e8643f8d19 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:24.034010 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58f997-f0f1-4722-b08d-dedd7e8521ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:24.034669 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58f997-f0f1-4722-b08d-dedd7e8521ed None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:24.034955 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58f997-f0f1-4722-b08d-dedd7e8521ed None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:24.035236 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58f997-f0f1-4722-b08d-dedd7e8521ed None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:24.036488 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58f997-f0f1-4722-b08d-dedd7e8521ed None admin] RBAC: Authorizing `identity:get_project(project_id=19ee209183e74289b7ddcfce7e067a7a)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:24.037901 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58f997-f0f1-4722-b08d-dedd7e8521ed None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:24.040551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 214/424] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:23 2022] GET /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:24.041028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fe9a7-5b2b-48cc-b0cb-9f308fe9b3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:24.041886 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fe9a7-5b2b-48cc-b0cb-9f308fe9b3cf None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:24.042403 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fe9a7-5b2b-48cc-b0cb-9f308fe9b3cf None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:24.042868 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fe9a7-5b2b-48cc-b0cb-9f308fe9b3cf None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:24.043800 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8fe9a7-5b2b-48cc-b0cb-9f308fe9b3cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:24.044318 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8fe9a7-5b2b-48cc-b0cb-9f308fe9b3cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:24.045990 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8fe9a7-5b2b-48cc-b0cb-9f308fe9b3cf None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:24.052247 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58f997-f0f1-4722-b08d-dedd7e8521ed None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:24.059904 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 211/425] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:24.062310 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fe9a7-5b2b-48cc-b0cb-9f308fe9b3cf None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:24.127735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:24.181296 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fe9a7-5b2b-48cc-b0cb-9f308fe9b3cf None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:24.217918 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89403e2-fcde-49ac-8a09-cb474fe0bea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:24.218539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89403e2-fcde-49ac-8a09-cb474fe0bea5 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:24.218816 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89403e2-fcde-49ac-8a09-cb474fe0bea5 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:24.219383 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89403e2-fcde-49ac-8a09-cb474fe0bea5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:24.266399 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:24.298263 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89403e2-fcde-49ac-8a09-cb474fe0bea5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:24.299806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89403e2-fcde-49ac-8a09-cb474fe0bea5 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:24.306195 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58f997-f0f1-4722-b08d-dedd7e8521ed None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:24.352207 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc9931-81cc-4b4e-b9da-36192bdef059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:24.352933 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc9931-81cc-4b4e-b9da-36192bdef059 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:24.353219 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc9931-81cc-4b4e-b9da-36192bdef059 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:24.353496 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc9931-81cc-4b4e-b9da-36192bdef059 None admin] PATH_INFO: `/v3/groups/dc732aa2652641d99c127014d8a881fb` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:24.355094 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc9931-81cc-4b4e-b9da-36192bdef059 None admin] RBAC: Authorizing `identity:get_group(group_id=dc732aa2652641d99c127014d8a881fb)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:24.356632 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc9931-81cc-4b4e-b9da-36192bdef059 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:24.358704 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 215/426] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Jul 28 11:04:24 2022] GET /identity/v3/groups/dc732aa2652641d99c127014d8a881fb => generated 226 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:24.358917 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:24.360102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413cf73-8f1f-480f-9265-acf67940572d None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:24.360273 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413cf73-8f1f-480f-9265-acf67940572d None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:24.360661 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413cf73-8f1f-480f-9265-acf67940572d None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:24.366485 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 216/427] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:24.367741 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413cf73-8f1f-480f-9265-acf67940572d None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:24.443525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 212/428] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 11:04:24.445520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33665e9-ea5f-429b-99c5-47efac45eb9d None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:24.445822 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33665e9-ea5f-429b-99c5-47efac45eb9d None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:24.446097 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33665e9-ea5f-429b-99c5-47efac45eb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:24.469727 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-e33665e9-ea5f-429b-99c5-47efac45eb9d None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:24.472033 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-e33665e9-ea5f-429b-99c5-47efac45eb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:24.514359 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413cf73-8f1f-480f-9265-acf67940572d None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:24.552510 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b18f25-eca0-4968-80bd-59d801d6a6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:24.553146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b18f25-eca0-4968-80bd-59d801d6a6dd None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:24.553425 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b18f25-eca0-4968-80bd-59d801d6a6dd None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:24.553700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b18f25-eca0-4968-80bd-59d801d6a6dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:24.555032 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b18f25-eca0-4968-80bd-59d801d6a6dd None admin] RBAC: Adding query filter params (group.id=dc732aa2652641d99c127014d8a881fb, role.id=05bb46007d644829b12b0d4ded0bd8d2, scope.project.id=19ee209183e74289b7ddcfce7e067a7a) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:24.555370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b18f25-eca0-4968-80bd-59d801d6a6dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:24.556900 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b18f25-eca0-4968-80bd-59d801d6a6dd None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:24.563614 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 217/429] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Jul 28 11:04:24 2022] GET /identity/v3/role_assignments?group.id=dc732aa2652641d99c127014d8a881fb&scope.project.id=19ee209183e74289b7ddcfce7e067a7a&role.id=05bb46007d644829b12b0d4ded0bd8d2 => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:24.564221 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b18f25-eca0-4968-80bd-59d801d6a6dd None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:24.566034 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 213/430] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:24.598746 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:24.613154 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33665e9-ea5f-429b-99c5-47efac45eb9d None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:24.715189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:24.749996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33665e9-ea5f-429b-99c5-47efac45eb9d None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:24.801364 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d5f94-3c94-48e5-87ac-099e1ffa2e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:24.802032 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d5f94-3c94-48e5-87ac-099e1ffa2e44 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:24.802320 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d5f94-3c94-48e5-87ac-099e1ffa2e44 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:24.802703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d5f94-3c94-48e5-87ac-099e1ffa2e44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:24.813131 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b18f25-eca0-4968-80bd-59d801d6a6dd None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:24.816769 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d5f94-3c94-48e5-87ac-099e1ffa2e44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:24.821750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-008d5f94-3c94-48e5-87ac-099e1ffa2e44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:24.821750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:24.821750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:24.821750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:24.821750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:24.821750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:24.821750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:24.821750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:24.821750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:24.821750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:24.821750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:24.821750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:24.821750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:24.821750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:24.821750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:24.821750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:24.822720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:24.822720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:24.822720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:24.822720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:24.822720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:24.822720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:24.822720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:24.822720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:24.822720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:24.822720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:24.822720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:24.822720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:24.822720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:24.822720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:24.822720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:24.822720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:24.823558 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:24.823558 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:24.823558 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:24.823558 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:24.823558 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:24.823558 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:24.823558 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:24.823558 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:24.823558 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:24.823558 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:24.823558 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 11:04:24.823558 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:24.823558 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 214/431] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:24.830546 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d5f94-3c94-48e5-87ac-099e1ffa2e44 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:24.869016 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb5c96-31e0-46e5-a30b-54771c5c6026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:24.870223 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb5c96-31e0-46e5-a30b-54771c5c6026 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:24.870507 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb5c96-31e0-46e5-a30b-54771c5c6026 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:24.870783 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb5c96-31e0-46e5-a30b-54771c5c6026 None admin] PATH_INFO: `/v3/projects/19ee209183e74289b7ddcfce7e067a7a` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:24.873511 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb5c96-31e0-46e5-a30b-54771c5c6026 None admin] RBAC: Authorizing `identity:get_project(project_id=19ee209183e74289b7ddcfce7e067a7a)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:24.875031 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb5c96-31e0-46e5-a30b-54771c5c6026 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:24.877265 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 218/432] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:24 2022] GET /identity/v3/projects/19ee209183e74289b7ddcfce7e067a7a => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:24.883013 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb5c96-31e0-46e5-a30b-54771c5c6026 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:24.979568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d5f94-3c94-48e5-87ac-099e1ffa2e44 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:24.992569 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:25.028125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb5c96-31e0-46e5-a30b-54771c5c6026 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:25.029524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd92f9e-ad9f-43a9-8f9d-801c8312c03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:25.030423 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd92f9e-ad9f-43a9-8f9d-801c8312c03c None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:25.030844 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd92f9e-ad9f-43a9-8f9d-801c8312c03c None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:25.031388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd92f9e-ad9f-43a9-8f9d-801c8312c03c None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:25.032336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd92f9e-ad9f-43a9-8f9d-801c8312c03c None admin] RBAC: Adding query filter params (name=member) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:25.032836 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd92f9e-ad9f-43a9-8f9d-801c8312c03c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:25.034417 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd92f9e-ad9f-43a9-8f9d-801c8312c03c None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:25.036221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:25.047564 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 215/433] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:04:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:25.056038 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd92f9e-ad9f-43a9-8f9d-801c8312c03c None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:25.071334 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e730909-5948-4ef7-b3a8-a8a24d7d8b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:25.072348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e730909-5948-4ef7-b3a8-a8a24d7d8b0c None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:25.072775 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e730909-5948-4ef7-b3a8-a8a24d7d8b0c None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:25.073053 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e730909-5948-4ef7-b3a8-a8a24d7d8b0c None admin] PATH_INFO: `/v3/groups/dc732aa2652641d99c127014d8a881fb` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:25.075403 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e730909-5948-4ef7-b3a8-a8a24d7d8b0c None admin] RBAC: Authorizing `identity:get_group(group_id=dc732aa2652641d99c127014d8a881fb)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:25.076997 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e730909-5948-4ef7-b3a8-a8a24d7d8b0c None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:25.079598 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 219/434] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Jul 28 11:04:24 2022] GET /identity/v3/groups/dc732aa2652641d99c127014d8a881fb => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:25.080392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75428b2-c3b2-4e5c-b12c-7177b80370fe None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:25.080623 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75428b2-c3b2-4e5c-b12c-7177b80370fe None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:25.080891 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75428b2-c3b2-4e5c-b12c-7177b80370fe None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:25.082962 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 220/435] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:25.084531 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75428b2-c3b2-4e5c-b12c-7177b80370fe None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:25.195148 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd92f9e-ad9f-43a9-8f9d-801c8312c03c None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:25.224597 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75428b2-c3b2-4e5c-b12c-7177b80370fe None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:25.244367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec27c24-57fa-4856-a86e-dba0a339bd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:25.245009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec27c24-57fa-4856-a86e-dba0a339bd69 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:25.245297 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec27c24-57fa-4856-a86e-dba0a339bd69 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:25.245580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec27c24-57fa-4856-a86e-dba0a339bd69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:25.275053 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224d579-4e60-4208-b8a0-9ec9ca139b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:25.275715 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224d579-4e60-4208-b8a0-9ec9ca139b66 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:25.275994 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224d579-4e60-4208-b8a0-9ec9ca139b66 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:25.276801 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224d579-4e60-4208-b8a0-9ec9ca139b66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:25.277059 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224d579-4e60-4208-b8a0-9ec9ca139b66 None admin] RBAC: Adding query filter params (group.id=dc732aa2652641d99c127014d8a881fb, role.id=e1248e4ba8a34052820e6bd72cdd8b72, scope.project.id=19ee209183e74289b7ddcfce7e067a7a) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:25.277369 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224d579-4e60-4208-b8a0-9ec9ca139b66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:25.278894 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224d579-4e60-4208-b8a0-9ec9ca139b66 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:25.290145 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 221/436] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Jul 28 11:04:25 2022] GET /identity/v3/role_assignments?group.id=dc732aa2652641d99c127014d8a881fb&scope.project.id=19ee209183e74289b7ddcfce7e067a7a&role.id=e1248e4ba8a34052820e6bd72cdd8b72 => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:25.292488 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffd9da-dd90-463b-9536-07a46da2e44e None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:25.292488 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffd9da-dd90-463b-9536-07a46da2e44e None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:25.292488 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffd9da-dd90-463b-9536-07a46da2e44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:25.318403 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-a5ffd9da-dd90-463b-9536-07a46da2e44e None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:25.319818 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-a5ffd9da-dd90-463b-9536-07a46da2e44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:25.330897 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:25.340461 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:25.349170 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec27c24-57fa-4856-a86e-dba0a339bd69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:25.350930 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec27c24-57fa-4856-a86e-dba0a339bd69 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:25.434546 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 222/437] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:25.459775 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffd9da-dd90-463b-9536-07a46da2e44e None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:25.482611 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 216/438] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:25.489052 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec27c24-57fa-4856-a86e-dba0a339bd69 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:25.596603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffd9da-dd90-463b-9536-07a46da2e44e None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:25.606549 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:25.617583 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec27c24-57fa-4856-a86e-dba0a339bd69 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:25.645178 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6162c5-1a5e-474d-b098-12f7efc5f09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:25.646143 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6162c5-1a5e-474d-b098-12f7efc5f09e None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:25.646628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6162c5-1a5e-474d-b098-12f7efc5f09e None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:25.647101 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6162c5-1a5e-474d-b098-12f7efc5f09e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:25.656377 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:25.663212 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6162c5-1a5e-474d-b098-12f7efc5f09e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:25.669125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-be6162c5-1a5e-474d-b098-12f7efc5f09e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:04:25.669125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:25.669125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:25.669125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:25.669125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:25.669125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:25.669125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:25.669125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:25.669125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:25.669125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:25.669125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:25.669125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:25.669125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:25.669125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:25.669125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:25.669125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:25.670042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:25.670042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:25.670042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:25.670042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:25.670042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:25.670042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:25.670042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:25.670042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:25.670042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:25.670042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:25.670042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:25.670042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:25.670042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:25.670042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:25.670042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:25.670042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:25.670829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:25.670829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:25.670829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:25.670829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:25.670829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:25.670829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:25.670829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:25.670829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:25.670829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:25.670829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:25.670829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 11:04:25.670829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:25.672541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5c39d-eb63-4d81-8b30-636dde40a73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:25.672541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5c39d-eb63-4d81-8b30-636dde40a73e None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:25.672541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5c39d-eb63-4d81-8b30-636dde40a73e None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:25.672541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5c39d-eb63-4d81-8b30-636dde40a73e None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:25.672800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 223/439] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:04:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:04:25.672868 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5c39d-eb63-4d81-8b30-636dde40a73e None admin] RBAC: Authorizing `identity:get_project(project_id=638dc1c8e7a34375b96fb45f061210f0)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:25.674405 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5c39d-eb63-4d81-8b30-636dde40a73e None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:25.676128 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 217/440] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:25 2022] GET /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:25.681265 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6162c5-1a5e-474d-b098-12f7efc5f09e None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:25.683177 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5c39d-eb63-4d81-8b30-636dde40a73e None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:25.817523 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6162c5-1a5e-474d-b098-12f7efc5f09e None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:25.832943 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5c39d-eb63-4d81-8b30-636dde40a73e None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:25.857785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a9883-29ce-4d55-8ccd-32643000c30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:25.858325 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a9883-29ce-4d55-8ccd-32643000c30c None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:25.858606 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a9883-29ce-4d55-8ccd-32643000c30c None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:25.858893 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a9883-29ce-4d55-8ccd-32643000c30c None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:25.859643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a9883-29ce-4d55-8ccd-32643000c30c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:25.859950 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a9883-29ce-4d55-8ccd-32643000c30c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:25.861336 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a9883-29ce-4d55-8ccd-32643000c30c None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:25.871656 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 224/441] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:25.877061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a9883-29ce-4d55-8ccd-32643000c30c None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:25.882300 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608e770-f506-4b77-8a85-f7ad14ff7dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:25.883066 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608e770-f506-4b77-8a85-f7ad14ff7dde None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:25.883444 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608e770-f506-4b77-8a85-f7ad14ff7dde None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:25.883793 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608e770-f506-4b77-8a85-f7ad14ff7dde None admin] PATH_INFO: `/v3/groups/dc732aa2652641d99c127014d8a881fb` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:25.885034 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608e770-f506-4b77-8a85-f7ad14ff7dde None admin] RBAC: Authorizing `identity:get_group(group_id=dc732aa2652641d99c127014d8a881fb)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:25.887126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608e770-f506-4b77-8a85-f7ad14ff7dde None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:25.893714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 218/442] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Jul 28 11:04:25 2022] GET /identity/v3/groups/dc732aa2652641d99c127014d8a881fb => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:25.894613 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608e770-f506-4b77-8a85-f7ad14ff7dde None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:25.928392 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:25.943244 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:25.985588 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a9883-29ce-4d55-8ccd-32643000c30c None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:26.014472 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608e770-f506-4b77-8a85-f7ad14ff7dde None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:26.023831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2e887-4810-469a-b560-c625b9489d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:26.024571 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2e887-4810-469a-b560-c625b9489d90 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:26.024889 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2e887-4810-469a-b560-c625b9489d90 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:26.025523 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2e887-4810-469a-b560-c625b9489d90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:26.054020 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426a5ed-2247-45b0-9fa1-ac6accc27730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:26.055311 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426a5ed-2247-45b0-9fa1-ac6accc27730 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:26.055593 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426a5ed-2247-45b0-9fa1-ac6accc27730 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:26.055870 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426a5ed-2247-45b0-9fa1-ac6accc27730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:26.056658 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426a5ed-2247-45b0-9fa1-ac6accc27730 None admin] RBAC: Adding query filter params (group.id=dc732aa2652641d99c127014d8a881fb, role.id=05bb46007d644829b12b0d4ded0bd8d2, scope.project.id=638dc1c8e7a34375b96fb45f061210f0) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:26.056969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426a5ed-2247-45b0-9fa1-ac6accc27730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:26.058657 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426a5ed-2247-45b0-9fa1-ac6accc27730 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:26.075547 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 219/443] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Jul 28 11:04:25 2022] GET /identity/v3/role_assignments?group.id=dc732aa2652641d99c127014d8a881fb&scope.project.id=638dc1c8e7a34375b96fb45f061210f0&role.id=05bb46007d644829b12b0d4ded0bd8d2 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:26.111120 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2e887-4810-469a-b560-c625b9489d90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:26.112554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2e887-4810-469a-b560-c625b9489d90 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:26.185636 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:26.232617 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 225/444] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 11:04:26.238454 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426a5ed-2247-45b0-9fa1-ac6accc27730 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:26.320746 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3475542-724b-40ce-a91b-7be3f0498a0f None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:26.321242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3475542-724b-40ce-a91b-7be3f0498a0f None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:26.321316 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3475542-724b-40ce-a91b-7be3f0498a0f None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:26.322634 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 226/445] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:04:26.327912 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049c21d-0a67-4f1d-b407-f2584546878d None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:26.328201 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049c21d-0a67-4f1d-b407-f2584546878d None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:26.328484 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049c21d-0a67-4f1d-b407-f2584546878d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:26.348032 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-0049c21d-0a67-4f1d-b407-f2584546878d None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:26.349928 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-0049c21d-0a67-4f1d-b407-f2584546878d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:26.352338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:26.359198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426a5ed-2247-45b0-9fa1-ac6accc27730 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:26.401710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e98884-5c53-4ad7-874d-28f201ae80a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:26.402375 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e98884-5c53-4ad7-874d-28f201ae80a2 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:26.402658 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e98884-5c53-4ad7-874d-28f201ae80a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:26.403009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e98884-5c53-4ad7-874d-28f201ae80a2 None admin] PATH_INFO: `/v3/projects/638dc1c8e7a34375b96fb45f061210f0` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:26.404268 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e98884-5c53-4ad7-874d-28f201ae80a2 None admin] RBAC: Authorizing `identity:get_project(project_id=638dc1c8e7a34375b96fb45f061210f0)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:26.406305 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e98884-5c53-4ad7-874d-28f201ae80a2 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:26.408819 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 220/446] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:26 2022] GET /identity/v3/projects/638dc1c8e7a34375b96fb45f061210f0 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:26.416610 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e98884-5c53-4ad7-874d-28f201ae80a2 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:26.437910 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 227/447] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:04:26.463525 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049c21d-0a67-4f1d-b407-f2584546878d None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:26.573097 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e98884-5c53-4ad7-874d-28f201ae80a2 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:26.603589 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:26.624232 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049c21d-0a67-4f1d-b407-f2584546878d None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:26.627244 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d846e-bed4-4e8f-9583-57873e22e532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:26.627876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d846e-bed4-4e8f-9583-57873e22e532 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:26.628160 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d846e-bed4-4e8f-9583-57873e22e532 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:26.628438 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d846e-bed4-4e8f-9583-57873e22e532 None admin] PATH_INFO: `/v3/groups/dc732aa2652641d99c127014d8a881fb` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:26.630555 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d846e-bed4-4e8f-9583-57873e22e532 None admin] RBAC: Authorizing `identity:get_group(group_id=dc732aa2652641d99c127014d8a881fb)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:26.632484 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d846e-bed4-4e8f-9583-57873e22e532 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:26.634230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 221/448] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Jul 28 11:04:26 2022] GET /identity/v3/groups/dc732aa2652641d99c127014d8a881fb => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:26.641187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d846e-bed4-4e8f-9583-57873e22e532 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:26.666402 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371c3f5-6a11-4315-8f7e-aa6863cb5341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:26.667160 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371c3f5-6a11-4315-8f7e-aa6863cb5341 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:26.667465 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371c3f5-6a11-4315-8f7e-aa6863cb5341 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:26.667749 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371c3f5-6a11-4315-8f7e-aa6863cb5341 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:26.673709 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:26.678758 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371c3f5-6a11-4315-8f7e-aa6863cb5341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:26.684382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-e371c3f5-6a11-4315-8f7e-aa6863cb5341 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:04:26.684382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:26.684382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:26.684382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:26.684382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:26.684382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:26.684382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:26.684382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:26.684382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:26.684382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:26.684382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:26.684382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:26.684382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:26.684382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:26.684382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:26.684382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:26.685461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:26.685461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:26.685461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:26.685461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:26.685461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:26.685461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:26.685461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:26.685461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:26.685461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:26.685461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:26.685461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:26.685461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:26.685461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:26.685461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:26.685461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:26.685461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:26.686254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:26.686254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:26.686254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:26.686254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:26.686254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:26.686254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:26.686254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:26.686254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:26.686254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:26.686254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:26.686254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:04:26.686254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:26.686254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 228/449] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Jul 28 11:04:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:04:26.691333 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371c3f5-6a11-4315-8f7e-aa6863cb5341 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:26.748066 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d846e-bed4-4e8f-9583-57873e22e532 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:26.781870 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf13ce-e625-49df-860a-febb3d1fb301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:26.782486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf13ce-e625-49df-860a-febb3d1fb301 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:26.782766 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf13ce-e625-49df-860a-febb3d1fb301 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:26.783044 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf13ce-e625-49df-860a-febb3d1fb301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:26.783858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf13ce-e625-49df-860a-febb3d1fb301 None admin] RBAC: Adding query filter params (group.id=dc732aa2652641d99c127014d8a881fb, role.id=e1248e4ba8a34052820e6bd72cdd8b72, scope.project.id=638dc1c8e7a34375b96fb45f061210f0) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:26.784168 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf13ce-e625-49df-860a-febb3d1fb301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:26.785620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf13ce-e625-49df-860a-febb3d1fb301 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:26.792453 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 222/450] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Jul 28 11:04:26 2022] GET /identity/v3/role_assignments?group.id=dc732aa2652641d99c127014d8a881fb&scope.project.id=638dc1c8e7a34375b96fb45f061210f0&role.id=e1248e4ba8a34052820e6bd72cdd8b72 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:26.800703 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371c3f5-6a11-4315-8f7e-aa6863cb5341 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:26.844857 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65244be-161a-4ae2-8c34-18e809122257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:26.845511 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65244be-161a-4ae2-8c34-18e809122257 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:26.845788 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65244be-161a-4ae2-8c34-18e809122257 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:26.846064 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65244be-161a-4ae2-8c34-18e809122257 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:26.846806 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65244be-161a-4ae2-8c34-18e809122257 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:26.847115 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65244be-161a-4ae2-8c34-18e809122257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:26.848597 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65244be-161a-4ae2-8c34-18e809122257 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:26.859213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 229/451] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:26.864955 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf13ce-e625-49df-860a-febb3d1fb301 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:26.972642 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:26.980913 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf13ce-e625-49df-860a-febb3d1fb301 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:27.014219 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd205610-0142-46b0-8fb0-2b4d30f8ff6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:27.014842 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd205610-0142-46b0-8fb0-2b4d30f8ff6e None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:27.015127 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd205610-0142-46b0-8fb0-2b4d30f8ff6e None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:27.015447 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd205610-0142-46b0-8fb0-2b4d30f8ff6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:27.086379 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd205610-0142-46b0-8fb0-2b4d30f8ff6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:27.087920 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd205610-0142-46b0-8fb0-2b4d30f8ff6e None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:27.181572 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:27.188579 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 223/452] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:27.194204 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65244be-161a-4ae2-8c34-18e809122257 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:27.213940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:27.295091 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65244be-161a-4ae2-8c34-18e809122257 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:27.329464 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b870d-192b-4159-a2b1-153070b66849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:27.330094 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b870d-192b-4159-a2b1-153070b66849 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:27.330379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b870d-192b-4159-a2b1-153070b66849 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:27.330656 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b870d-192b-4159-a2b1-153070b66849 None admin] PATH_INFO: `/v3/projects/584d842f145544c78397d7b263b77dae` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:27.331834 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b870d-192b-4159-a2b1-153070b66849 None admin] RBAC: Authorizing `identity:get_project(project_id=584d842f145544c78397d7b263b77dae)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:27.333272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b870d-192b-4159-a2b1-153070b66849 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:27.334911 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 230/453] 10.222.0.71 () {56 vars in 1186 bytes} [Thu Jul 28 11:04:27 2022] GET /identity/v3/projects/584d842f145544c78397d7b263b77dae => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:27.341018 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd205610-0142-46b0-8fb0-2b4d30f8ff6e None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:27.438669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd205610-0142-46b0-8fb0-2b4d30f8ff6e None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:27.472373 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b744b-81fd-42b7-86d7-2a3c865d6ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:27.473016 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b744b-81fd-42b7-86d7-2a3c865d6ab0 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:27.473303 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b744b-81fd-42b7-86d7-2a3c865d6ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:27.473585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b744b-81fd-42b7-86d7-2a3c865d6ab0 None admin] PATH_INFO: `/v3/groups/b0b9f0f82836495ba6ab061b8f5e55a5` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:27.474727 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b744b-81fd-42b7-86d7-2a3c865d6ab0 None admin] RBAC: Authorizing `identity:get_group(group_id=b0b9f0f82836495ba6ab061b8f5e55a5)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:27.476261 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b744b-81fd-42b7-86d7-2a3c865d6ab0 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:27.477905 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 224/454] 10.222.0.71 () {56 vars in 1180 bytes} [Thu Jul 28 11:04:27 2022] GET /identity/v3/groups/b0b9f0f82836495ba6ab061b8f5e55a5 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:27.484080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b870d-192b-4159-a2b1-153070b66849 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:27.566801 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:27.585959 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b870d-192b-4159-a2b1-153070b66849 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:27.618895 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9afba1c-735b-4a67-a0ce-1f1df2d6b51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:27.619538 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afba1c-735b-4a67-a0ce-1f1df2d6b51a None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:27.619823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afba1c-735b-4a67-a0ce-1f1df2d6b51a None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:27.620102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afba1c-735b-4a67-a0ce-1f1df2d6b51a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:27.620881 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9afba1c-735b-4a67-a0ce-1f1df2d6b51a None admin] RBAC: Adding query filter params (group.id=b0b9f0f82836495ba6ab061b8f5e55a5, role.id=f2a8452a65264f9ea10467160b1bd735, scope.project.id=584d842f145544c78397d7b263b77dae) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:27.621192 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9afba1c-735b-4a67-a0ce-1f1df2d6b51a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:27.622617 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9afba1c-735b-4a67-a0ce-1f1df2d6b51a None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:27.628339 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 231/455] 10.222.0.71 () {56 vars in 1376 bytes} [Thu Jul 28 11:04:27 2022] GET /identity/v3/role_assignments?group.id=b0b9f0f82836495ba6ab061b8f5e55a5&scope.project.id=584d842f145544c78397d7b263b77dae&role.id=f2a8452a65264f9ea10467160b1bd735 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:30.189997 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fcba4-e348-447a-8bfa-a461a1dae3b0 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:30.190533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fcba4-e348-447a-8bfa-a461a1dae3b0 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:30.190533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fcba4-e348-447a-8bfa-a461a1dae3b0 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:30.192461 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 225/456] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:30.198889 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e2af6-1f12-4124-b4a6-c7c473b61a9f None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:30.199434 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e2af6-1f12-4124-b4a6-c7c473b61a9f None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:30.199508 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e2af6-1f12-4124-b4a6-c7c473b61a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:30.218885 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-7d8e2af6-1f12-4124-b4a6-c7c473b61a9f None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:30.220152 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-7d8e2af6-1f12-4124-b4a6-c7c473b61a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:30.301782 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 232/457] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:30.321785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fcba4-e348-447a-8bfa-a461a1dae3b0 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:30.368390 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980b377-183f-44e5-953c-13d9ed4d25ad None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:30.368703 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980b377-183f-44e5-953c-13d9ed4d25ad None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:30.368955 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980b377-183f-44e5-953c-13d9ed4d25ad None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:30.373064 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 233/458] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:30.379757 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aa5a5-b694-404d-ba96-c0141af2d1ec None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:30.379757 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aa5a5-b694-404d-ba96-c0141af2d1ec None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:30.379757 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aa5a5-b694-404d-ba96-c0141af2d1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:30.395147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:30.398901 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-fa0aa5a5-b694-404d-ba96-c0141af2d1ec None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:30.400529 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-fa0aa5a5-b694-404d-ba96-c0141af2d1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:30.449145 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fcba4-e348-447a-8bfa-a461a1dae3b0 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:30.485798 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 234/459] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:04:30.485798 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6a71c-5b99-4e06-b771-bb71b4ca4d89 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:30.485798 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6a71c-5b99-4e06-b771-bb71b4ca4d89 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:30.485798 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6a71c-5b99-4e06-b771-bb71b4ca4d89 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:30.486396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 235/460] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:30.491137 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc618100-18e8-4ed4-a2dd-893a5adc7267 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:30.491630 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc618100-18e8-4ed4-a2dd-893a5adc7267 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:30.492585 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc618100-18e8-4ed4-a2dd-893a5adc7267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:30.497463 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43adf0-a0f4-462f-9910-532b0b19592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:30.498235 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43adf0-a0f4-462f-9910-532b0b19592c None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:30.498623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43adf0-a0f4-462f-9910-532b0b19592c None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:30.499050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43adf0-a0f4-462f-9910-532b0b19592c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:30.506772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:30.510334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43adf0-a0f4-462f-9910-532b0b19592c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:30.512194 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43adf0-a0f4-462f-9910-532b0b19592c None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:30.513815 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-fc618100-18e8-4ed4-a2dd-893a5adc7267 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:30.515036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-fc618100-18e8-4ed4-a2dd-893a5adc7267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:30.528596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-5b43adf0-a0f4-462f-9910-532b0b19592c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:30.528596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:30.528596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:30.528596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:30.528596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:30.528596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:30.528596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:30.528596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:30.528596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:30.528596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:30.528596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:30.528596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:30.528596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:30.528596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:30.528596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:30.529488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:30.529488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:30.529488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:30.529488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:30.529488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:30.529488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:30.529488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:30.529488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:30.529488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:30.529488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:30.529488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:30.529488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:30.529488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:30.529488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:30.529488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:30.529488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:30.529488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:30.530316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:30.530316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:30.530316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:30.530316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:30.536396 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 226/461] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:30.536396 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43adf0-a0f4-462f-9910-532b0b19592c None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:30.599050 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 236/462] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:04:30.599050 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc618100-18e8-4ed4-a2dd-893a5adc7267 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:30.641827 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43adf0-a0f4-462f-9910-532b0b19592c None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:30.660026 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:30.681193 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd8ba6-e861-4a6d-8eb8-bb5f256b39e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:30.681936 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd8ba6-e861-4a6d-8eb8-bb5f256b39e6 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:30.682292 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd8ba6-e861-4a6d-8eb8-bb5f256b39e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:30.682576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd8ba6-e861-4a6d-8eb8-bb5f256b39e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:30.695456 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd8ba6-e861-4a6d-8eb8-bb5f256b39e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:30.696949 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd8ba6-e861-4a6d-8eb8-bb5f256b39e6 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:30.706140 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc618100-18e8-4ed4-a2dd-893a5adc7267 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:30.712647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-bfbd8ba6-e861-4a6d-8eb8-bb5f256b39e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:30.712647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:30.712647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:30.712647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:30.712647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:30.712647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:30.712647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:30.712647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:30.712647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:30.712647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:30.712647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:30.712647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:30.712647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:30.712647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:30.712647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:30.713508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:30.713508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:30.713508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:30.713508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:30.713508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:30.713508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:30.713508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:30.713508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:30.713508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:30.713508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:30.713508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:30.713508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:30.713508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:30.713508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:30.713508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:30.713508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:30.713508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:30.715075 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:30.715075 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:30.715075 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:30.715075 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:30.715075 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 227/463] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:30.715075 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd8ba6-e861-4a6d-8eb8-bb5f256b39e6 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:30.752563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c86333-ffc0-4143-a30e-bed770f61e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:30.753224 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c86333-ffc0-4143-a30e-bed770f61e44 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:30.753502 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c86333-ffc0-4143-a30e-bed770f61e44 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:30.753801 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c86333-ffc0-4143-a30e-bed770f61e44 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:30.754547 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c86333-ffc0-4143-a30e-bed770f61e44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:30.754857 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c86333-ffc0-4143-a30e-bed770f61e44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:30.756350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c86333-ffc0-4143-a30e-bed770f61e44 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:30.762147 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:30.777002 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 237/464] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:30.777681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c86333-ffc0-4143-a30e-bed770f61e44 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:30.854196 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd8ba6-e861-4a6d-8eb8-bb5f256b39e6 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:30.887769 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf92aa-a0c4-453d-8542-89eaec9045a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:30.888514 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf92aa-a0c4-453d-8542-89eaec9045a7 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:30.888873 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf92aa-a0c4-453d-8542-89eaec9045a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:30.889208 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf92aa-a0c4-453d-8542-89eaec9045a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:30.896622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c86333-ffc0-4143-a30e-bed770f61e44 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:30.900831 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf92aa-a0c4-453d-8542-89eaec9045a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:30.902290 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf92aa-a0c4-453d-8542-89eaec9045a7 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:30.917089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-93cf92aa-a0c4-453d-8542-89eaec9045a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:30.917089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:30.917089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:30.917089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:30.917089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:30.917089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:30.917089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:30.917089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:30.917089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:30.917089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:30.917089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:30.917089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:30.917089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:30.917089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:30.917089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:30.917973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:30.917973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:30.917973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:30.917973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:30.917973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:30.917973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:30.917973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:30.917973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:30.917973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:30.917973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:30.917973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:30.917973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:30.917973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:30.917973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:30.917973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:30.917973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:30.917973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:30.918838 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:30.918838 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:30.918838 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:30.918838 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:30.918838 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 228/465] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:30.919093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf92aa-a0c4-453d-8542-89eaec9045a7 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:30.940970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84fbb8-15ad-4a34-ba33-b36dfcd288bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:30.941879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84fbb8-15ad-4a34-ba33-b36dfcd288bf None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:30.942229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84fbb8-15ad-4a34-ba33-b36dfcd288bf None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:30.942532 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84fbb8-15ad-4a34-ba33-b36dfcd288bf None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:30.943299 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84fbb8-15ad-4a34-ba33-b36dfcd288bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:30.943651 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84fbb8-15ad-4a34-ba33-b36dfcd288bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:30.945764 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:30.949683 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84fbb8-15ad-4a34-ba33-b36dfcd288bf None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:30.964959 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 238/466] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:30.966102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d698d1-5ee6-4ffa-98fe-0f01c9fc3f42 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:30.966374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d698d1-5ee6-4ffa-98fe-0f01c9fc3f42 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:30.966655 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d698d1-5ee6-4ffa-98fe-0f01c9fc3f42 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:30.967893 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 239/467] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:30.968579 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d698d1-5ee6-4ffa-98fe-0f01c9fc3f42 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:31.027876 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:31.034003 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf92aa-a0c4-453d-8542-89eaec9045a7 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:31.068185 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfe1f8-19fe-461e-b3c4-d1c4ec80c70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:31.068808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfe1f8-19fe-461e-b3c4-d1c4ec80c70b None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:31.069100 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfe1f8-19fe-461e-b3c4-d1c4ec80c70b None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:31.069383 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfe1f8-19fe-461e-b3c4-d1c4ec80c70b None admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:31.070569 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcfe1f8-19fe-461e-b3c4-d1c4ec80c70b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:31.072050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcfe1f8-19fe-461e-b3c4-d1c4ec80c70b None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:31.073849 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d698d1-5ee6-4ffa-98fe-0f01c9fc3f42 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:31.093602 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 229/468] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Jul 28 11:04:30 2022] POST /identity/v3/users => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:04:31.094413 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfe1f8-19fe-461e-b3c4-d1c4ec80c70b None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:31.120630 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c381f72-a839-4214-aa2f-c2244c0e4bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:31.121289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c381f72-a839-4214-aa2f-c2244c0e4bd6 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:31.121567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c381f72-a839-4214-aa2f-c2244c0e4bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:31.121842 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c381f72-a839-4214-aa2f-c2244c0e4bd6 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:31.122617 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c381f72-a839-4214-aa2f-c2244c0e4bd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:31.122927 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c381f72-a839-4214-aa2f-c2244c0e4bd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:31.124426 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c381f72-a839-4214-aa2f-c2244c0e4bd6 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:31.139118 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 240/469] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:31.140347 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e50489-4b48-42fa-89f3-19162b93ae0c None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:31.140638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e50489-4b48-42fa-89f3-19162b93ae0c None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:31.140917 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e50489-4b48-42fa-89f3-19162b93ae0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:31.160157 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-d3e50489-4b48-42fa-89f3-19162b93ae0c None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:31.161400 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-d3e50489-4b48-42fa-89f3-19162b93ae0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:31.196407 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:31.227427 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfe1f8-19fe-461e-b3c4-d1c4ec80c70b None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:31.249881 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 241/470] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:31.250602 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e50489-4b48-42fa-89f3-19162b93ae0c None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:31.279795 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67873447-5a5c-4133-8b82-cfa103cb18ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:31.280534 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67873447-5a5c-4133-8b82-cfa103cb18ca None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:31.280814 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67873447-5a5c-4133-8b82-cfa103cb18ca None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:31.281155 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67873447-5a5c-4133-8b82-cfa103cb18ca None admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:31.281845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67873447-5a5c-4133-8b82-cfa103cb18ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:31.283600 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67873447-5a5c-4133-8b82-cfa103cb18ca None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:31.309491 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 230/471] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Jul 28 11:04:31 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:04:31.309680 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67873447-5a5c-4133-8b82-cfa103cb18ca None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:31.312510 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:31.392217 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e50489-4b48-42fa-89f3-19162b93ae0c None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:31.442019 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50c120-5234-487e-8a3a-39be583daf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:31.443337 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50c120-5234-487e-8a3a-39be583daf0f None admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:31.443821 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50c120-5234-487e-8a3a-39be583daf0f None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:31.444466 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50c120-5234-487e-8a3a-39be583daf0f None admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:31.446469 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50c120-5234-487e-8a3a-39be583daf0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:31.449424 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50c120-5234-487e-8a3a-39be583daf0f None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:31.465765 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67873447-5a5c-4133-8b82-cfa103cb18ca None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:31.490264 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 242/472] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Jul 28 11:04:31 2022] POST /identity/v3/users => generated 248 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:04:31.517897 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:31.524532 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b6c4f-4be7-4a3d-bbea-adcdb3b427a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:31.525498 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6c4f-4be7-4a3d-bbea-adcdb3b427a8 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:31.525966 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6c4f-4be7-4a3d-bbea-adcdb3b427a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:31.526323 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6c4f-4be7-4a3d-bbea-adcdb3b427a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:31.540777 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b6c4f-4be7-4a3d-bbea-adcdb3b427a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:31.542411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b6c4f-4be7-4a3d-bbea-adcdb3b427a8 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:31.560117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-ac4b6c4f-4be7-4a3d-bbea-adcdb3b427a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:31.560117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:31.560117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:31.560117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:31.560117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:31.560117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:31.560117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:31.560117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:31.560117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:31.560117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:31.560117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:31.560117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:31.560117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:31.560117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:31.560117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:31.561222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:31.561222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:31.561222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:31.561222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:31.561222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:31.561222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:31.561222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:31.561222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:31.561222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:31.561222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:31.561222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:31.561222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:31.561222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:31.561222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:31.561222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:31.561222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:31.561222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:31.562284 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:31.562284 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:31.562284 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:31.562284 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:31.563647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 231/473] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:31.569744 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50c120-5234-487e-8a3a-39be583daf0f None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:31.699346 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50c120-5234-487e-8a3a-39be583daf0f None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:31.701497 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:31.740068 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c0308-c763-45e2-b24b-e2df5ec1e2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:31.740916 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c0308-c763-45e2-b24b-e2df5ec1e2c4 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:31.741247 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c0308-c763-45e2-b24b-e2df5ec1e2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:31.741626 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c0308-c763-45e2-b24b-e2df5ec1e2c4 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:31.743001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c0308-c763-45e2-b24b-e2df5ec1e2c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:31.743459 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c0308-c763-45e2-b24b-e2df5ec1e2c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:31.744983 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c0308-c763-45e2-b24b-e2df5ec1e2c4 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:31.758355 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 243/474] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:31.763928 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b6c4f-4be7-4a3d-bbea-adcdb3b427a8 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:31.881896 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b6c4f-4be7-4a3d-bbea-adcdb3b427a8 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:31.935338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f5c9b-8fab-4b8a-acc5-931a4abecb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:31.936435 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f5c9b-8fab-4b8a-acc5-931a4abecb13 None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:31.936924 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f5c9b-8fab-4b8a-acc5-931a4abecb13 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:31.937402 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f5c9b-8fab-4b8a-acc5-931a4abecb13 None admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:31.938279 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f5c9b-8fab-4b8a-acc5-931a4abecb13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:31.939980 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f5c9b-8fab-4b8a-acc5-931a4abecb13 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:31.964793 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 232/475] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Jul 28 11:04:31 2022] POST /identity/v3/users => generated 249 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:04:33.644858 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ff04d-f671-48d2-9a42-c3e13204917d None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:33.645343 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ff04d-f671-48d2-9a42-c3e13204917d None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:33.645343 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ff04d-f671-48d2-9a42-c3e13204917d None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:33.646923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 244/476] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:33.652471 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b3e55-ba91-4d14-914e-7af86de8f497 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:33.652884 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b3e55-ba91-4d14-914e-7af86de8f497 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:33.653054 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b3e55-ba91-4d14-914e-7af86de8f497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:33.671786 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-003b3e55-ba91-4d14-914e-7af86de8f497 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:33.672996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-003b3e55-ba91-4d14-914e-7af86de8f497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:33.711288 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:33.750701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 233/477] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:33.759338 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82d041-7963-43d8-8ee5-16bf9729dd7d None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:33.759778 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82d041-7963-43d8-8ee5-16bf9729dd7d None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:33.760158 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82d041-7963-43d8-8ee5-16bf9729dd7d None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:33.762242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 245/478] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:33.768302 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a171e-9b92-4ab0-affb-1b0da5c1a02f None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:33.768727 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a171e-9b92-4ab0-affb-1b0da5c1a02f None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:33.769011 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a171e-9b92-4ab0-affb-1b0da5c1a02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:33.781890 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82d041-7963-43d8-8ee5-16bf9729dd7d None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:33.791140 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-826a171e-9b92-4ab0-affb-1b0da5c1a02f None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:33.792888 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-826a171e-9b92-4ab0-affb-1b0da5c1a02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:33.874565 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 234/479] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:33.901861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a171e-9b92-4ab0-affb-1b0da5c1a02f None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:33.915597 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82d041-7963-43d8-8ee5-16bf9729dd7d None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:33.955111 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63caa30e-1959-4bfd-9002-a0454c2e1745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:33.955887 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caa30e-1959-4bfd-9002-a0454c2e1745 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:33.956170 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caa30e-1959-4bfd-9002-a0454c2e1745 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:33.956545 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caa30e-1959-4bfd-9002-a0454c2e1745 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:33.968056 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63caa30e-1959-4bfd-9002-a0454c2e1745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:33.973213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-63caa30e-1959-4bfd-9002-a0454c2e1745 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:33.973213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:33.973213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:33.973213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:33.973213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:33.973213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:33.973213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:33.973213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:33.973213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:33.973213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:33.973213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:33.973213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:33.973213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:33.973213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:33.973213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:33.973213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:33.974080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:33.974080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:33.974080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:33.974080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:33.974080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:33.974080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:33.974080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:33.974080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:33.974080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:33.974080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:33.974080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:33.974080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:33.974080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:33.974080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:33.974080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:33.974080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:33.974869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:33.974869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:33.974869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:33.974869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:33.974869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:33.974869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:33.974869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:33.974869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:33.974869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:33.974869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:33.974869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:33.974869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:33.974869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 246/480] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Jul 28 11:04:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:33.976376 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de45c06-e811-440a-b04e-7582f45546f5 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:33.976664 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de45c06-e811-440a-b04e-7582f45546f5 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:33.976942 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de45c06-e811-440a-b04e-7582f45546f5 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:33.978363 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 247/481] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:33.982989 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de45c06-e811-440a-b04e-7582f45546f5 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:34.014188 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:34.022684 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:34.027116 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a171e-9b92-4ab0-affb-1b0da5c1a02f None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:34.072117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fba66-f982-4fd2-b7a8-0a26b942f130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:34.073205 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fba66-f982-4fd2-b7a8-0a26b942f130 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:34.073490 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fba66-f982-4fd2-b7a8-0a26b942f130 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:34.074152 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fba66-f982-4fd2-b7a8-0a26b942f130 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:34.087702 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fba66-f982-4fd2-b7a8-0a26b942f130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:34.092856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-5b5fba66-f982-4fd2-b7a8-0a26b942f130 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:34.092856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:34.092856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:34.092856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:34.092856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:34.092856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:34.092856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:34.092856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:34.092856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:34.092856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:34.092856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:34.092856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:34.092856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:34.092856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:34.092856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:34.092856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:34.093732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:34.093732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:34.093732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:34.093732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:34.093732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:34.093732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:34.093732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:34.093732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:34.093732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:34.093732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:34.093732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:34.093732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:34.093732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:34.093732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:34.093732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:34.093732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:34.094528 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:34.094528 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:34.094528 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:34.094528 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:34.094528 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:34.094528 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:34.094528 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:34.094528 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:34.094528 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:34.094528 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:34.094528 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:34.094528 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:34.094528 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 235/482] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Jul 28 11:04:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:34.095819 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c89c1-bddc-42b0-9c50-8aff89d0e4be None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:34.095819 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c89c1-bddc-42b0-9c50-8aff89d0e4be None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:34.095819 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c89c1-bddc-42b0-9c50-8aff89d0e4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:34.102679 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de45c06-e811-440a-b04e-7582f45546f5 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:34.115185 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-034c89c1-bddc-42b0-9c50-8aff89d0e4be None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:34.116521 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-034c89c1-bddc-42b0-9c50-8aff89d0e4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:34.139392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2e977-0f40-4522-8618-7abb44d8ad84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:34.140015 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2e977-0f40-4522-8618-7abb44d8ad84 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:34.140296 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2e977-0f40-4522-8618-7abb44d8ad84 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:34.140575 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2e977-0f40-4522-8618-7abb44d8ad84 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:34.141283 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2e977-0f40-4522-8618-7abb44d8ad84 None admin] RBAC: Adding query filter params (name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:34.141588 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2e977-0f40-4522-8618-7abb44d8ad84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:34.142986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2e977-0f40-4522-8618-7abb44d8ad84 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:34.152483 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 248/483] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Jul 28 11:04:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:34.153272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2e977-0f40-4522-8618-7abb44d8ad84 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:34.208561 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 236/484] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:34.220966 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c89c1-bddc-42b0-9c50-8aff89d0e4be None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:34.251905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:34.270037 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2e977-0f40-4522-8618-7abb44d8ad84 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:34.318538 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9310aa6-e5f1-4234-a391-ddb7b04ff4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:34.319165 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9310aa6-e5f1-4234-a391-ddb7b04ff4cf None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:34.319476 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9310aa6-e5f1-4234-a391-ddb7b04ff4cf None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:34.319788 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9310aa6-e5f1-4234-a391-ddb7b04ff4cf None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:34.321421 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9310aa6-e5f1-4234-a391-ddb7b04ff4cf None admin] RBAC: Adding query filter params (name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:34.321728 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9310aa6-e5f1-4234-a391-ddb7b04ff4cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:34.323460 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9310aa6-e5f1-4234-a391-ddb7b04ff4cf None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:34.332039 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 249/485] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Jul 28 11:04:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:34.332841 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9310aa6-e5f1-4234-a391-ddb7b04ff4cf None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:34.334106 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:34.345963 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c89c1-bddc-42b0-9c50-8aff89d0e4be None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:34.384087 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac9c03-836d-447f-988c-c8483039931c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:34.384742 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac9c03-836d-447f-988c-c8483039931c None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:34.385027 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac9c03-836d-447f-988c-c8483039931c None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:34.385305 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac9c03-836d-447f-988c-c8483039931c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:34.396201 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac9c03-836d-447f-988c-c8483039931c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:34.397755 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac9c03-836d-447f-988c-c8483039931c None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:34.412591 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-f9ac9c03-836d-447f-988c-c8483039931c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:34.412591 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:34.412591 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:34.412591 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:34.412591 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:34.412591 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:34.412591 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:34.412591 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:34.412591 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:34.412591 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:34.412591 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:34.412591 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:34.412591 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:34.412591 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:34.412591 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:34.413714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:34.413714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:34.413714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:34.413714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:34.413714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:34.413714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:34.413714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:34.413714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:34.413714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:34.413714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:34.413714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:34.413714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:34.413714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:34.413714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:34.413714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:34.413714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:34.413714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:34.414758 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:34.414758 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:34.414758 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:34.414758 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:34.415423 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 237/486] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:34.417243 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973048fc-2bae-4288-97a4-1b54b17faf33 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:34.417533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973048fc-2bae-4288-97a4-1b54b17faf33 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:34.417815 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973048fc-2bae-4288-97a4-1b54b17faf33 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:34.419197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 238/487] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:34.419933 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973048fc-2bae-4288-97a4-1b54b17faf33 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:34.440041 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9310aa6-e5f1-4234-a391-ddb7b04ff4cf None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:34.476265 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c8d21-1d85-47e9-9125-d6048e887963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:34.476914 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c8d21-1d85-47e9-9125-d6048e887963 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:34.477202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c8d21-1d85-47e9-9125-d6048e887963 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:34.477477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c8d21-1d85-47e9-9125-d6048e887963 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:34.487731 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c8d21-1d85-47e9-9125-d6048e887963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:34.493723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-697c8d21-1d85-47e9-9125-d6048e887963 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:34.493723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:34.493723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:34.493723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:34.493723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:34.493723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:34.493723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:34.493723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:34.493723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:34.493723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:34.493723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:34.493723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:34.493723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:34.493723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:34.493723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:34.493723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:34.494794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:34.494794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:34.494794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:34.494794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:34.494794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:34.494794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:34.494794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:34.494794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:34.494794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:34.494794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:34.494794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:34.494794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:34.494794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:34.494794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:34.494794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:34.494794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:34.495791 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:34.495791 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:34.495791 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:34.495791 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:34.495791 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:34.495791 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:34.495791 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:34.495791 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:34.495791 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:34.495791 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:34.495791 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:34.495791 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:34.495791 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 250/488] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Jul 28 11:04:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:34.495791 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c8d21-1d85-47e9-9125-d6048e887963 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:34.504063 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:34.530449 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973048fc-2bae-4288-97a4-1b54b17faf33 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:34.564345 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10ea28-74e9-4c4a-a5fa-a1c1a835d654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:34.564983 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10ea28-74e9-4c4a-a5fa-a1c1a835d654 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:34.565271 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10ea28-74e9-4c4a-a5fa-a1c1a835d654 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:34.565547 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10ea28-74e9-4c4a-a5fa-a1c1a835d654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:34.577031 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10ea28-74e9-4c4a-a5fa-a1c1a835d654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:34.578490 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10ea28-74e9-4c4a-a5fa-a1c1a835d654 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:34.580287 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:34.594575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-7d10ea28-74e9-4c4a-a5fa-a1c1a835d654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:34.594575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:34.594575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:34.594575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:34.594575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:34.594575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:34.594575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:34.594575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:34.594575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:34.594575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:34.594575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:34.594575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:34.594575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:34.594575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:34.594575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:34.595665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:34.595665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:34.595665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:34.595665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:34.595665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:34.595665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:34.595665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:34.595665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:34.595665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:34.595665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:34.595665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:34.595665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:34.595665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:34.595665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:34.595665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:34.595665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:34.595665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:34.596496 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:34.596496 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:34.596496 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:34.596496 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:34.596496 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 239/489] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:34.597066 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea0ccb-2f8a-4766-9b07-dc05c758d45f None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:34.597347 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea0ccb-2f8a-4766-9b07-dc05c758d45f None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:34.597628 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea0ccb-2f8a-4766-9b07-dc05c758d45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:34.603376 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c8d21-1d85-47e9-9125-d6048e887963 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:34.615315 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-88ea0ccb-2f8a-4766-9b07-dc05c758d45f None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:34.616508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-88ea0ccb-2f8a-4766-9b07-dc05c758d45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:34.639941 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c4c38-8b3a-4857-a5a5-243dcc9b6ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:34.640572 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c4c38-8b3a-4857-a5a5-243dcc9b6ce0 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:34.640856 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c4c38-8b3a-4857-a5a5-243dcc9b6ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:34.641132 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c4c38-8b3a-4857-a5a5-243dcc9b6ce0 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:34.641834 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c4c38-8b3a-4857-a5a5-243dcc9b6ce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:34.642139 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c4c38-8b3a-4857-a5a5-243dcc9b6ce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:34.643557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c4c38-8b3a-4857-a5a5-243dcc9b6ce0 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:34.663979 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 251/490] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:34.663979 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c4c38-8b3a-4857-a5a5-243dcc9b6ce0 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:34.691164 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 240/491] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:34.692049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea0ccb-2f8a-4766-9b07-dc05c758d45f None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:34.731338 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:34.766641 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c4c38-8b3a-4857-a5a5-243dcc9b6ce0 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:34.801114 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69534023-311d-4fa1-8290-adb627cd60d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:34.801745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69534023-311d-4fa1-8290-adb627cd60d8 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:34.802032 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69534023-311d-4fa1-8290-adb627cd60d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:34.802311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69534023-311d-4fa1-8290-adb627cd60d8 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:34.803029 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69534023-311d-4fa1-8290-adb627cd60d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:34.803368 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69534023-311d-4fa1-8290-adb627cd60d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:34.803856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea0ccb-2f8a-4766-9b07-dc05c758d45f None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:34.804766 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69534023-311d-4fa1-8290-adb627cd60d8 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:34.813786 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 252/492] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Jul 28 11:04:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:34.814668 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69534023-311d-4fa1-8290-adb627cd60d8 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:34.831354 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:34.843238 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a47c3-a9eb-4f56-8bd9-8fded32661ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:34.843900 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a47c3-a9eb-4f56-8bd9-8fded32661ff None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:34.844186 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a47c3-a9eb-4f56-8bd9-8fded32661ff None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:34.844467 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a47c3-a9eb-4f56-8bd9-8fded32661ff None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:34.845165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a47c3-a9eb-4f56-8bd9-8fded32661ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:34.845475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a47c3-a9eb-4f56-8bd9-8fded32661ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:34.846862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a47c3-a9eb-4f56-8bd9-8fded32661ff None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:34.858719 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 241/493] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:34.859865 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a47c3-a9eb-4f56-8bd9-8fded32661ff None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:34.920651 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69534023-311d-4fa1-8290-adb627cd60d8 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:34.947450 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:34.955504 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0e291-2c22-442c-b2d0-7c1d35e2e48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:34.956161 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0e291-2c22-442c-b2d0-7c1d35e2e48a None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:34.956458 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0e291-2c22-442c-b2d0-7c1d35e2e48a None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:34.956730 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0e291-2c22-442c-b2d0-7c1d35e2e48a None admin] PATH_INFO: `/v3/users/nova` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:34.960085 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a47c3-a9eb-4f56-8bd9-8fded32661ff None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:34.964499 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0e291-2c22-442c-b2d0-7c1d35e2e48a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:34.965992 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0e291-2c22-442c-b2d0-7c1d35e2e48a None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:34.978606 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-71f0e291-2c22-442c-b2d0-7c1d35e2e48a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 11:04:34.978606 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:34.978606 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:34.978606 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:34.978606 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:34.978606 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:34.978606 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:34.978606 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:34.978606 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:34.978606 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:34.978606 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:34.978606 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:34.978606 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:04:34.978606 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:04:34.978606 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:04:34.978606 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:04:34.979699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:34.979699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:34.979699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:04:34.979699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:34.979699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:04:34.979699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:34.979699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:34.979699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:34.979699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:34.979699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:34.979699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:34.979699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:34.979699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:34.979699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:34.979699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:34.979699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:34.979699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:34.979699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:34.980601 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:34.980601 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:34.980601 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:04:34.980601 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:04:34.980601 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:04:34.980601 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:04:34.980601 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:04:34.980601 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:04:34.980601 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 11:04:34.980601 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:34.980601 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 253/494] 10.222.0.71 () {56 vars in 1093 bytes} [Thu Jul 28 11:04:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:34.980601 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0e291-2c22-442c-b2d0-7c1d35e2e48a None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:34.998384 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3d9ae-0c58-4ded-a2c0-ac7854918cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:34.999020 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3d9ae-0c58-4ded-a2c0-ac7854918cc5 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:34.999361 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3d9ae-0c58-4ded-a2c0-ac7854918cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:34.999639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3d9ae-0c58-4ded-a2c0-ac7854918cc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:35.010283 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3d9ae-0c58-4ded-a2c0-ac7854918cc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:35.015950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-1cb3d9ae-0c58-4ded-a2c0-ac7854918cc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:35.015950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:35.015950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:35.015950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:35.015950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:35.015950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:35.015950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:35.015950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:35.015950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:35.015950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:35.015950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:35.015950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:35.015950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:35.015950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:35.015950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:35.015950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:35.017025 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:35.017025 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:35.017025 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:35.017025 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:35.017025 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:35.017025 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:35.017025 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:35.017025 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:35.017025 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:35.017025 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:35.017025 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:35.017025 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:35.017025 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:35.017025 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:35.017025 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:35.017025 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:35.017850 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:35.017850 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:35.017850 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:35.017850 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:35.017850 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:35.017850 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:35.017850 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:35.017850 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:35.017850 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:35.017850 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:35.017850 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:35.017850 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:35.017850 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 242/495] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Jul 28 11:04:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:35.020607 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3d9ae-0c58-4ded-a2c0-ac7854918cc5 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:35.064973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:35.080998 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0e291-2c22-442c-b2d0-7c1d35e2e48a None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:35.114134 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77003c4f-7166-4627-9510-861aa547d7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:35.114780 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77003c4f-7166-4627-9510-861aa547d7af None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:35.115061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77003c4f-7166-4627-9510-861aa547d7af None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:35.115365 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77003c4f-7166-4627-9510-861aa547d7af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:35.118812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3d9ae-0c58-4ded-a2c0-ac7854918cc5 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:35.126312 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77003c4f-7166-4627-9510-861aa547d7af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:35.127830 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77003c4f-7166-4627-9510-861aa547d7af None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:35.143662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-77003c4f-7166-4627-9510-861aa547d7af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:35.143662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:35.143662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:35.143662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:35.143662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:35.143662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:35.143662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:35.143662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:35.143662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:35.143662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:35.143662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:35.143662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:35.143662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:35.143662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:35.143662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:35.144563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:35.144563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:35.144563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:35.144563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:35.144563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:35.144563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:35.144563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:35.144563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:35.144563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:35.144563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:35.144563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:35.144563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:35.144563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:35.144563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:35.144563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:35.144563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:35.144563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:35.145416 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:35.145416 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:35.145416 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:35.145416 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:35.145416 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 254/496] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:35.146014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77003c4f-7166-4627-9510-861aa547d7af None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:35.154209 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbe106-caa1-4303-8486-621385f7f1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:35.154866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbe106-caa1-4303-8486-621385f7f1be None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:35.155155 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbe106-caa1-4303-8486-621385f7f1be None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:35.155476 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbe106-caa1-4303-8486-621385f7f1be None admin] PATH_INFO: `/v3/users/glance` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:35.164178 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dbe106-caa1-4303-8486-621385f7f1be None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:35.165640 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dbe106-caa1-4303-8486-621385f7f1be None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:35.178465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-75dbe106-caa1-4303-8486-621385f7f1be None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 11:04:35.178465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:35.178465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:35.178465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:35.178465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:35.178465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:35.178465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:35.178465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:35.178465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:35.178465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:35.178465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:35.178465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:35.178465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:04:35.178465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:04:35.178465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:04:35.178465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:04:35.179969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:35.179969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:35.179969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:04:35.179969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:35.179969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:04:35.179969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:35.179969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:35.179969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:35.179969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:35.179969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:35.179969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:35.179969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:35.179969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:35.179969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:35.179969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:35.179969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:35.179969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:35.179969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:35.180846 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:35.180846 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:35.180846 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:04:35.180846 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:04:35.180846 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:04:35.180846 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:04:35.180846 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:04:35.180846 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:04:35.180846 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 11:04:35.180846 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:35.180846 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 243/497] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:35.181394 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbe106-caa1-4303-8486-621385f7f1be None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:35.192517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:35.251753 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77003c4f-7166-4627-9510-861aa547d7af None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:35.282572 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbe106-caa1-4303-8486-621385f7f1be None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:35.285380 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cd997-c232-4198-b255-5c667cba9ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:35.285521 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:35.285616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cd997-c232-4198-b255-5c667cba9ed7 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:35.285853 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cd997-c232-4198-b255-5c667cba9ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:35.286210 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cd997-c232-4198-b255-5c667cba9ed7 None admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:35.287013 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299cd997-c232-4198-b255-5c667cba9ed7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:35.287360 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299cd997-c232-4198-b255-5c667cba9ed7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:35.289346 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299cd997-c232-4198-b255-5c667cba9ed7 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:35.318837 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5821a2-57a2-4546-8217-8c9ab9e78ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:35.319494 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5821a2-57a2-4546-8217-8c9ab9e78ac6 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:35.319811 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5821a2-57a2-4546-8217-8c9ab9e78ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:35.320083 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5821a2-57a2-4546-8217-8c9ab9e78ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:35.320795 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5821a2-57a2-4546-8217-8c9ab9e78ac6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:35.321096 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5821a2-57a2-4546-8217-8c9ab9e78ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:35.322486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5821a2-57a2-4546-8217-8c9ab9e78ac6 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:35.326612 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 255/498] 10.222.0.71 () {56 vars in 1133 bytes} [Thu Jul 28 11:04:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:35.327499 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cd997-c232-4198-b255-5c667cba9ed7 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:35.331016 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 244/499] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Jul 28 11:04:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:35.332092 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5821a2-57a2-4546-8217-8c9ab9e78ac6 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:35.433711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:35.438346 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cd997-c232-4198-b255-5c667cba9ed7 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:35.440166 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5821a2-57a2-4546-8217-8c9ab9e78ac6 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:35.474940 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0ccc1-d0fb-4c20-a19e-7e0d49d26026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:35.475600 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0ccc1-d0fb-4c20-a19e-7e0d49d26026 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:35.475883 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0ccc1-d0fb-4c20-a19e-7e0d49d26026 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:35.476705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0ccc1-d0fb-4c20-a19e-7e0d49d26026 None admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:35.477532 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0ccc1-d0fb-4c20-a19e-7e0d49d26026 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:35.477789 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0ccc1-d0fb-4c20-a19e-7e0d49d26026 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:35.479254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0ccc1-d0fb-4c20-a19e-7e0d49d26026 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:35.479814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12caf437-9673-40c1-ab9d-d862aec4f625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:35.480439 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12caf437-9673-40c1-ab9d-d862aec4f625 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:35.480721 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12caf437-9673-40c1-ab9d-d862aec4f625 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:35.481001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12caf437-9673-40c1-ab9d-d862aec4f625 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:35.481694 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12caf437-9673-40c1-ab9d-d862aec4f625 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:35.482014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12caf437-9673-40c1-ab9d-d862aec4f625 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:35.483394 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12caf437-9673-40c1-ab9d-d862aec4f625 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:35.496242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 256/500] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:35.497097 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12caf437-9673-40c1-ab9d-d862aec4f625 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:35.517953 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 245/501] 10.222.0.71 () {56 vars in 1137 bytes} [Thu Jul 28 11:04:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:35.518816 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0ccc1-d0fb-4c20-a19e-7e0d49d26026 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:35.544808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:35.604922 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12caf437-9673-40c1-ab9d-d862aec4f625 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:35.622176 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0ccc1-d0fb-4c20-a19e-7e0d49d26026 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:35.640392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3404b-88c1-40db-8c3b-28f2ac5efece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:35.641015 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3404b-88c1-40db-8c3b-28f2ac5efece None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:35.641301 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3404b-88c1-40db-8c3b-28f2ac5efece None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:35.641580 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3404b-88c1-40db-8c3b-28f2ac5efece None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:35.656107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b01c1-a871-4c17-8e42-91b05f6595bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:35.656762 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b01c1-a871-4c17-8e42-91b05f6595bc None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:35.657045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b01c1-a871-4c17-8e42-91b05f6595bc None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:35.657320 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b01c1-a871-4c17-8e42-91b05f6595bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:35.668041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b01c1-a871-4c17-8e42-91b05f6595bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:35.669532 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b01c1-a871-4c17-8e42-91b05f6595bc None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:35.669933 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:35.685592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-d42b01c1-a871-4c17-8e42-91b05f6595bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:35.685592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:35.685592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:35.685592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:35.685592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:35.685592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:35.685592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:35.685592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:35.685592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:35.685592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:35.685592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:35.685592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:35.685592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:35.685592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:35.685592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:35.686580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:35.686580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:35.686580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:35.686580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:35.686580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:35.686580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:35.686580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:35.686580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:35.686580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:35.686580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:35.686580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:35.686580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:35.686580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:35.686580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:35.686580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:35.686580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:35.686580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:35.687508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:35.687508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:35.687508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:35.687508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:35.687508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 246/502] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:35.687808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b01c1-a871-4c17-8e42-91b05f6595bc None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:35.716559 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3404b-88c1-40db-8c3b-28f2ac5efece None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:35.718056 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3404b-88c1-40db-8c3b-28f2ac5efece None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:35.763098 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:35.786969 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b01c1-a871-4c17-8e42-91b05f6595bc None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:35.818469 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 257/503] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:35.819349 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3404b-88c1-40db-8c3b-28f2ac5efece None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:35.826495 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497456e0-b4dc-4389-afae-aac4166133d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:35.827153 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497456e0-b4dc-4389-afae-aac4166133d3 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:35.827469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497456e0-b4dc-4389-afae-aac4166133d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:35.827755 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497456e0-b4dc-4389-afae-aac4166133d3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:35.838022 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497456e0-b4dc-4389-afae-aac4166133d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:35.839551 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497456e0-b4dc-4389-afae-aac4166133d3 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:35.852110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-497456e0-b4dc-4389-afae-aac4166133d3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 11:04:35.852110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:35.852110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:35.852110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:35.852110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:35.852110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:35.852110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:35.852110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:35.852110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:35.852110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:35.852110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:35.852110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:35.852110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:04:35.852110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:04:35.852110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:04:35.852110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:04:35.853882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:35.853882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:35.853882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:04:35.853882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:35.853882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:04:35.853882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:35.853882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:35.853882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:35.853882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:35.853882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:35.853882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:35.853882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:35.853882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:35.853882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:35.853882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:35.853882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:35.853882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:35.853882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:35.855178 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:35.855178 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:35.855178 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:04:35.855178 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:04:35.855178 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:04:35.855178 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:04:35.855178 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:04:35.855178 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:04:35.855178 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 11:04:35.855178 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:35.855178 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 247/504] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:35.855178 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497456e0-b4dc-4389-afae-aac4166133d3 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:35.888146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:35.935772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3404b-88c1-40db-8c3b-28f2ac5efece None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:35.974200 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237b2d6-2506-49b6-9ddc-fbc7ef1e385b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:35.974842 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237b2d6-2506-49b6-9ddc-fbc7ef1e385b None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:35.975113 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237b2d6-2506-49b6-9ddc-fbc7ef1e385b None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:35.975435 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237b2d6-2506-49b6-9ddc-fbc7ef1e385b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:36.047499 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237b2d6-2506-49b6-9ddc-fbc7ef1e385b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:36.049075 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237b2d6-2506-49b6-9ddc-fbc7ef1e385b None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:36.081075 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497456e0-b4dc-4389-afae-aac4166133d3 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:36.106010 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:36.116013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb377134-43d6-4a1c-b469-21d9f1b6873f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:36.116640 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb377134-43d6-4a1c-b469-21d9f1b6873f None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:36.116920 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb377134-43d6-4a1c-b469-21d9f1b6873f None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:36.117200 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb377134-43d6-4a1c-b469-21d9f1b6873f None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:36.117890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb377134-43d6-4a1c-b469-21d9f1b6873f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:36.118193 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb377134-43d6-4a1c-b469-21d9f1b6873f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:36.119613 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb377134-43d6-4a1c-b469-21d9f1b6873f None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:36.121957 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:36.134399 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 248/505] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:36.135460 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb377134-43d6-4a1c-b469-21d9f1b6873f None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:36.155875 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 258/506] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:36.156961 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237b2d6-2506-49b6-9ddc-fbc7ef1e385b None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:36.243665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb377134-43d6-4a1c-b469-21d9f1b6873f None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:36.255537 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237b2d6-2506-49b6-9ddc-fbc7ef1e385b None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:36.277844 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9bc10-0ce6-43df-9e8e-388dfed6067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:36.278484 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9bc10-0ce6-43df-9e8e-388dfed6067d None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:36.278764 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9bc10-0ce6-43df-9e8e-388dfed6067d None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:36.279039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9bc10-0ce6-43df-9e8e-388dfed6067d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:36.289582 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9bc10-0ce6-43df-9e8e-388dfed6067d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:36.291069 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9bc10-0ce6-43df-9e8e-388dfed6067d None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:36.291931 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53140af-a349-4cba-b666-2513ce7cecfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:36.292548 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53140af-a349-4cba-b666-2513ce7cecfd None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:36.292829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53140af-a349-4cba-b666-2513ce7cecfd None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:36.293099 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53140af-a349-4cba-b666-2513ce7cecfd None admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:36.293892 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53140af-a349-4cba-b666-2513ce7cecfd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:36.294196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53140af-a349-4cba-b666-2513ce7cecfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:36.295633 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53140af-a349-4cba-b666-2513ce7cecfd None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:36.305443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-2ca9bc10-0ce6-43df-9e8e-388dfed6067d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:36.305443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:36.305443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:36.305443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:36.305443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:36.305443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:36.305443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:36.305443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:36.305443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:36.305443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:36.305443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:36.305443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:36.305443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:36.305443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:36.305443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:36.306322 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:36.306322 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:36.306322 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:36.306322 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:36.306322 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:36.306322 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:36.306322 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:36.306322 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:36.306322 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:36.306322 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:36.306322 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:36.306322 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:36.306322 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:36.306322 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:36.306322 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:36.306322 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:36.306322 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:36.307148 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:36.307148 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:36.307148 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:36.307148 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:36.307414 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 249/507] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:36.308250 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9bc10-0ce6-43df-9e8e-388dfed6067d None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:36.321519 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 259/508] 10.222.0.71 () {56 vars in 1137 bytes} [Thu Jul 28 11:04:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:36.321519 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53140af-a349-4cba-b666-2513ce7cecfd None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:36.336121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:36.362138 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:36.418764 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9bc10-0ce6-43df-9e8e-388dfed6067d None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:36.422624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53140af-a349-4cba-b666-2513ce7cecfd None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:36.453473 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f7a5d-79a3-4e44-aecc-f6448bf3f6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:36.454124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f7a5d-79a3-4e44-aecc-f6448bf3f6a0 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:36.454412 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f7a5d-79a3-4e44-aecc-f6448bf3f6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:36.454693 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f7a5d-79a3-4e44-aecc-f6448bf3f6a0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:36.458233 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aee0a7-9fc0-46dc-8226-1cce16c87472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:36.458882 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aee0a7-9fc0-46dc-8226-1cce16c87472 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:36.459169 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aee0a7-9fc0-46dc-8226-1cce16c87472 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:36.459478 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aee0a7-9fc0-46dc-8226-1cce16c87472 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:36.462560 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f7a5d-79a3-4e44-aecc-f6448bf3f6a0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:36.463962 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f7a5d-79a3-4e44-aecc-f6448bf3f6a0 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:36.471404 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aee0a7-9fc0-46dc-8226-1cce16c87472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:36.472900 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aee0a7-9fc0-46dc-8226-1cce16c87472 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:36.477231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-733f7a5d-79a3-4e44-aecc-f6448bf3f6a0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 11:04:36.477231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:36.477231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:36.477231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:36.477231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:36.477231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:36.477231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:36.477231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:36.477231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:36.477231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:36.477231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:36.477231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:36.477231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:04:36.477231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:04:36.477231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:04:36.477231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:04:36.478187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:36.478187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:36.478187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:04:36.478187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:36.478187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:04:36.478187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:36.478187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:36.478187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:36.478187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:36.478187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:36.478187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:36.478187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:36.478187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:36.478187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:36.478187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:36.478187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:36.478187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:36.478187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:36.479513 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:36.479513 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:36.479513 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:04:36.479513 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:04:36.479513 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:04:36.479513 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:04:36.479513 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:04:36.479513 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:04:36.479513 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 11:04:36.479513 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:36.479513 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 250/509] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Jul 28 11:04:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:36.479513 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f7a5d-79a3-4e44-aecc-f6448bf3f6a0 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:36.492374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-f5aee0a7-9fc0-46dc-8226-1cce16c87472 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:36.492374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:36.492374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:36.492374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:36.492374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:36.492374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:36.492374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:36.492374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:36.492374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:36.492374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:36.492374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:36.492374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:36.492374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:36.492374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:36.492374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:36.493451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:36.493451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:36.493451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:36.493451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:36.493451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:36.493451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:36.493451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:36.493451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:36.493451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:36.493451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:36.493451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:36.493451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:36.493451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:36.493451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:36.493451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:36.493451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:36.493451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:36.494350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:36.494350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:36.494350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:36.494350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:36.494350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 260/510] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:36.495409 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aee0a7-9fc0-46dc-8226-1cce16c87472 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:36.563875 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:36.592684 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f7a5d-79a3-4e44-aecc-f6448bf3f6a0 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:36.601898 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aee0a7-9fc0-46dc-8226-1cce16c87472 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:36.605299 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:36.633958 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5ad17-ecae-463b-83e7-9266eafe406e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:36.634590 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5ad17-ecae-463b-83e7-9266eafe406e None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:36.634877 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5ad17-ecae-463b-83e7-9266eafe406e None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:36.635159 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5ad17-ecae-463b-83e7-9266eafe406e None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:36.635890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5ad17-ecae-463b-83e7-9266eafe406e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:36.636459 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5ad17-ecae-463b-83e7-9266eafe406e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:36.637842 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5ad17-ecae-463b-83e7-9266eafe406e None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:36.648807 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddbc45-87d7-4340-a894-f187155a6419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:36.649421 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddbc45-87d7-4340-a894-f187155a6419 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:36.649702 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddbc45-87d7-4340-a894-f187155a6419 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:36.649977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddbc45-87d7-4340-a894-f187155a6419 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:36.650797 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 251/511] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:36.651819 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5ad17-ecae-463b-83e7-9266eafe406e None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:36.733070 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ddbc45-87d7-4340-a894-f187155a6419 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:36.734652 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ddbc45-87d7-4340-a894-f187155a6419 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:36.762487 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5ad17-ecae-463b-83e7-9266eafe406e None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:36.797331 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285700d5-bab5-45ea-9562-7428eb4bdbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:36.798019 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285700d5-bab5-45ea-9562-7428eb4bdbba None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:36.798225 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285700d5-bab5-45ea-9562-7428eb4bdbba None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:36.798500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285700d5-bab5-45ea-9562-7428eb4bdbba None admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:36.799314 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285700d5-bab5-45ea-9562-7428eb4bdbba None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:36.799619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285700d5-bab5-45ea-9562-7428eb4bdbba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:36.801057 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285700d5-bab5-45ea-9562-7428eb4bdbba None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:36.803469 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:36.824606 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 252/512] 10.222.0.71 () {56 vars in 1139 bytes} [Thu Jul 28 11:04:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:36.824814 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285700d5-bab5-45ea-9562-7428eb4bdbba None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:36.848736 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 261/513] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:36.850134 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddbc45-87d7-4340-a894-f187155a6419 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:36.857865 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:36.934777 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285700d5-bab5-45ea-9562-7428eb4bdbba None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:36.955421 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddbc45-87d7-4340-a894-f187155a6419 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:36.969949 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984aae47-3192-48a7-8794-7b49f554da5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:36.970584 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984aae47-3192-48a7-8794-7b49f554da5f None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:36.970871 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984aae47-3192-48a7-8794-7b49f554da5f None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:36.971152 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984aae47-3192-48a7-8794-7b49f554da5f None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:36.971901 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984aae47-3192-48a7-8794-7b49f554da5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:36.972215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984aae47-3192-48a7-8794-7b49f554da5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:36.973629 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984aae47-3192-48a7-8794-7b49f554da5f None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:36.986281 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 253/514] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:36.986936 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984aae47-3192-48a7-8794-7b49f554da5f None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:36.993985 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98602b-b006-496d-b3f1-b3733f7e65d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:36.994639 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98602b-b006-496d-b3f1-b3733f7e65d8 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:36.994923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98602b-b006-496d-b3f1-b3733f7e65d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:36.995202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98602b-b006-496d-b3f1-b3733f7e65d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:37.002151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98602b-b006-496d-b3f1-b3733f7e65d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:37.003630 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98602b-b006-496d-b3f1-b3733f7e65d8 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:37.016331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-0b98602b-b006-496d-b3f1-b3733f7e65d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:37.016331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:37.016331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:37.016331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:37.016331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:37.016331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:37.016331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:37.016331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:37.016331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:37.016331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:37.016331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:37.016331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:37.016331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:04:37.016331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:04:37.016331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:04:37.017370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:04:37.017370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:37.017370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:37.017370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:37.017370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:37.017370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:37.017370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:37.017370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:37.017370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:37.017370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:37.017370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:37.017370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:37.017370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:37.017370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:37.017370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:37.017370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:37.017370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:37.023650 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:04:37.023650 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:04:37.023650 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:04:37.023650 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:04:37.023650 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:04:37.023650 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:04:37.023650 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:37.023650 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:37.023650 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 262/515] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:37.023650 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98602b-b006-496d-b3f1-b3733f7e65d8 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:37.049398 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:37.078661 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:37.093777 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984aae47-3192-48a7-8794-7b49f554da5f None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:37.121043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98602b-b006-496d-b3f1-b3733f7e65d8 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:37.126919 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77952e3-f87f-4529-96a2-1726589df667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:37.127572 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77952e3-f87f-4529-96a2-1726589df667 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:37.127857 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77952e3-f87f-4529-96a2-1726589df667 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:37.128130 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77952e3-f87f-4529-96a2-1726589df667 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:37.155139 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e4905-7d59-4db0-8b0a-906fe0756164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:37.155808 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e4905-7d59-4db0-8b0a-906fe0756164 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:37.156088 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e4905-7d59-4db0-8b0a-906fe0756164 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:37.156369 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e4905-7d59-4db0-8b0a-906fe0756164 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:37.167566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e4905-7d59-4db0-8b0a-906fe0756164 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:37.169021 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e4905-7d59-4db0-8b0a-906fe0756164 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:37.183937 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-567e4905-7d59-4db0-8b0a-906fe0756164 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:37.183937 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:37.183937 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:37.183937 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:37.183937 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:37.183937 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:37.183937 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:37.183937 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:37.183937 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:37.183937 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:37.183937 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:37.183937 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:37.183937 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:37.183937 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:37.183937 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:37.185004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:37.185004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:37.185004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:37.185004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:37.185004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:37.185004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:37.185004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:37.185004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:37.185004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:37.185004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:37.185004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:37.185004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:37.185004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:37.185004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:37.185004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:37.185004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:37.185004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:37.185883 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:37.185883 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:37.185883 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:37.185883 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:37.185883 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 263/516] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:37.186148 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e4905-7d59-4db0-8b0a-906fe0756164 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:37.200334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77952e3-f87f-4529-96a2-1726589df667 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:37.201820 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77952e3-f87f-4529-96a2-1726589df667 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:37.266986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:37.286382 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:37.286833 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e4905-7d59-4db0-8b0a-906fe0756164 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:37.305400 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 254/517] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:37.306246 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77952e3-f87f-4529-96a2-1726589df667 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:37.322127 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78a160-f0a7-422b-8917-7c0c2b06d8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:37.322770 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78a160-f0a7-422b-8917-7c0c2b06d8a0 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:37.323055 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78a160-f0a7-422b-8917-7c0c2b06d8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:37.323433 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78a160-f0a7-422b-8917-7c0c2b06d8a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:37.330061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78a160-f0a7-422b-8917-7c0c2b06d8a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:37.331557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78a160-f0a7-422b-8917-7c0c2b06d8a0 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:37.343611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-eb78a160-f0a7-422b-8917-7c0c2b06d8a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:37.343611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:37.343611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:37.343611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:37.343611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:37.343611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:37.343611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:37.343611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:37.343611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:37.343611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:37.343611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:37.343611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:37.343611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:04:37.343611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:04:37.343611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:04:37.344628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:04:37.344628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:37.344628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:37.344628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:37.344628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:37.344628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:37.344628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:37.344628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:37.344628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:37.344628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:37.344628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:37.344628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:37.344628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:37.344628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:37.344628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:37.344628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:37.344628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:37.345466 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:04:37.345466 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:04:37.345466 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:04:37.345466 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:04:37.345466 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:04:37.345466 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:04:37.345466 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:37.345466 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:37.345466 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 264/518] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:37.346096 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78a160-f0a7-422b-8917-7c0c2b06d8a0 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:37.408681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77952e3-f87f-4529-96a2-1726589df667 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:37.442510 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef54b50-58f1-443d-be1b-fc6af366e2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:37.443131 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef54b50-58f1-443d-be1b-fc6af366e2d2 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:37.443442 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef54b50-58f1-443d-be1b-fc6af366e2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:37.443721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef54b50-58f1-443d-be1b-fc6af366e2d2 None admin] PATH_INFO: `/v3/projects` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:37.444462 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef54b50-58f1-443d-be1b-fc6af366e2d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:37.444768 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef54b50-58f1-443d-be1b-fc6af366e2d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:37.446197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef54b50-58f1-443d-be1b-fc6af366e2d2 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:37.449364 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78a160-f0a7-422b-8917-7c0c2b06d8a0 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:37.464198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 255/519] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:04:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:37.465016 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef54b50-58f1-443d-be1b-fc6af366e2d2 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:37.488460 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa88b22-86bc-4423-b0ec-b83cab8cfa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:37.489084 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa88b22-86bc-4423-b0ec-b83cab8cfa2a None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:37.489365 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa88b22-86bc-4423-b0ec-b83cab8cfa2a None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:37.489640 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa88b22-86bc-4423-b0ec-b83cab8cfa2a None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:37.490331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa88b22-86bc-4423-b0ec-b83cab8cfa2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:37.490638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa88b22-86bc-4423-b0ec-b83cab8cfa2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:37.492125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa88b22-86bc-4423-b0ec-b83cab8cfa2a None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:37.501530 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:37.508176 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 265/520] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:37.509132 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa88b22-86bc-4423-b0ec-b83cab8cfa2a None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:37.514870 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:37.572508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef54b50-58f1-443d-be1b-fc6af366e2d2 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:37.608175 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c340a-02ee-4fca-a933-8727de52f173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:37.608822 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c340a-02ee-4fca-a933-8727de52f173 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:37.609110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c340a-02ee-4fca-a933-8727de52f173 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:37.609394 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c340a-02ee-4fca-a933-8727de52f173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:37.616789 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa88b22-86bc-4423-b0ec-b83cab8cfa2a None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:37.619567 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c340a-02ee-4fca-a933-8727de52f173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:37.621038 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c340a-02ee-4fca-a933-8727de52f173 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:37.636839 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-615c340a-02ee-4fca-a933-8727de52f173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:37.636839 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:37.636839 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:37.636839 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:37.636839 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:37.636839 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:37.636839 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:37.636839 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:37.636839 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:37.636839 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:37.636839 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:37.636839 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:37.636839 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:37.636839 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:37.636839 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:37.637862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:37.637862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:37.637862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:37.637862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:37.637862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:37.637862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:37.637862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:37.637862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:37.637862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:37.637862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:37.637862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:37.637862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:37.637862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:37.637862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:37.637862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:37.637862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:37.637862 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:37.638948 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:37.638948 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:37.638948 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:37.638948 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:37.638948 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 256/521] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:37.639760 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c340a-02ee-4fca-a933-8727de52f173 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:37.654677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03c3a8-3642-4368-b083-ae892e2ffef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:37.655358 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03c3a8-3642-4368-b083-ae892e2ffef7 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:37.655629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03c3a8-3642-4368-b083-ae892e2ffef7 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:37.655909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03c3a8-3642-4368-b083-ae892e2ffef7 None admin] PATH_INFO: `/v3/projects` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:37.656668 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03c3a8-3642-4368-b083-ae892e2ffef7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:37.656984 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03c3a8-3642-4368-b083-ae892e2ffef7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:37.658431 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03c3a8-3642-4368-b083-ae892e2ffef7 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:37.680924 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 266/522] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:04:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:37.682011 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03c3a8-3642-4368-b083-ae892e2ffef7 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:37.742977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:37.746175 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:37.751462 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c340a-02ee-4fca-a933-8727de52f173 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:37.786138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03c3a8-3642-4368-b083-ae892e2ffef7 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:37.786930 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ca8b4-0d46-4085-9b5e-dffdd2d31101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:37.787496 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ca8b4-0d46-4085-9b5e-dffdd2d31101 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:37.787782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ca8b4-0d46-4085-9b5e-dffdd2d31101 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:37.788058 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ca8b4-0d46-4085-9b5e-dffdd2d31101 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:37.788905 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ca8b4-0d46-4085-9b5e-dffdd2d31101 None admin] RBAC: Adding query filter params (role.id=2889c6a70cf04dfda4618a8374822c11, scope.project.id=11f4749185bf4adba9ae3cf927b6880b, user.id=2bf7f66ba696444f8055a498e292a182) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:37.789217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ca8b4-0d46-4085-9b5e-dffdd2d31101 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:37.790663 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ca8b4-0d46-4085-9b5e-dffdd2d31101 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:37.796073 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 257/523] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:04:37 2022] GET /identity/v3/role_assignments?user.id=2bf7f66ba696444f8055a498e292a182&scope.project.id=11f4749185bf4adba9ae3cf927b6880b&role.id=2889c6a70cf04dfda4618a8374822c11 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:37.796855 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ca8b4-0d46-4085-9b5e-dffdd2d31101 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:37.824234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637555d0-b70a-406b-b4d7-8bdacc6b32f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:37.825215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637555d0-b70a-406b-b4d7-8bdacc6b32f7 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:37.825458 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637555d0-b70a-406b-b4d7-8bdacc6b32f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:37.825640 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637555d0-b70a-406b-b4d7-8bdacc6b32f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:37.837209 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637555d0-b70a-406b-b4d7-8bdacc6b32f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:37.838740 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637555d0-b70a-406b-b4d7-8bdacc6b32f7 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:37.851725 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-637555d0-b70a-406b-b4d7-8bdacc6b32f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:37.851725 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:37.851725 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:37.851725 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:37.851725 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:37.851725 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:37.851725 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:37.851725 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:37.851725 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:37.851725 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:37.851725 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:37.851725 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:37.851725 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:04:37.851725 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:04:37.851725 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:04:37.852642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:04:37.852642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:37.852642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:37.852642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:37.852642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:37.852642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:37.852642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:37.852642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:37.852642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:37.852642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:37.852642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:37.852642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:37.852642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:37.852642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:37.852642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:37.852642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:37.852642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:37.853629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:04:37.853629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:04:37.853629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:04:37.853629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:04:37.853629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:04:37.853629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:04:37.853629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:37.853629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:37.853629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 267/524] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:37.854087 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637555d0-b70a-406b-b4d7-8bdacc6b32f7 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:37.934762 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ca8b4-0d46-4085-9b5e-dffdd2d31101 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:37.974793 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637555d0-b70a-406b-b4d7-8bdacc6b32f7 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:37.974989 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29eaac-cee2-4161-8137-d8a6eabe5046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:37.975515 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29eaac-cee2-4161-8137-d8a6eabe5046 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:37.975799 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29eaac-cee2-4161-8137-d8a6eabe5046 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:37.976070 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29eaac-cee2-4161-8137-d8a6eabe5046 None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:37.976944 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29eaac-cee2-4161-8137-d8a6eabe5046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:37.977248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29eaac-cee2-4161-8137-d8a6eabe5046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:37.978643 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29eaac-cee2-4161-8137-d8a6eabe5046 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:37.995201 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 258/525] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:37.996138 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29eaac-cee2-4161-8137-d8a6eabe5046 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:38.001208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:38.017258 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005243b7-9398-428c-8f93-15bf29845a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:38.017883 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005243b7-9398-428c-8f93-15bf29845a10 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:38.018168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005243b7-9398-428c-8f93-15bf29845a10 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:38.018452 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005243b7-9398-428c-8f93-15bf29845a10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:38.019254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005243b7-9398-428c-8f93-15bf29845a10 None admin] RBAC: Adding query filter params (role.id=2889c6a70cf04dfda4618a8374822c11, scope.project.id=11f4749185bf4adba9ae3cf927b6880b, user.id=51f33b105ddb4c81a9ead57fd2d888ac) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:38.019615 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005243b7-9398-428c-8f93-15bf29845a10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:38.021098 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005243b7-9398-428c-8f93-15bf29845a10 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:38.022339 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:38.039302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 268/526] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:04:37 2022] GET /identity/v3/role_assignments?user.id=51f33b105ddb4c81a9ead57fd2d888ac&scope.project.id=11f4749185bf4adba9ae3cf927b6880b&role.id=2889c6a70cf04dfda4618a8374822c11 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:38.039302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005243b7-9398-428c-8f93-15bf29845a10 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:38.176306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29eaac-cee2-4161-8137-d8a6eabe5046 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:38.218638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005243b7-9398-428c-8f93-15bf29845a10 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:38.245679 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a79e5e-5d48-4ccb-b659-24c0dacf4a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:38.246419 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a79e5e-5d48-4ccb-b659-24c0dacf4a6a None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:38.246831 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a79e5e-5d48-4ccb-b659-24c0dacf4a6a None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:38.247493 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a79e5e-5d48-4ccb-b659-24c0dacf4a6a None admin] PATH_INFO: `/v3/projects` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:38.248277 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a79e5e-5d48-4ccb-b659-24c0dacf4a6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:38.248608 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a79e5e-5d48-4ccb-b659-24c0dacf4a6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:38.250948 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a79e5e-5d48-4ccb-b659-24c0dacf4a6a None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:38.262740 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275a28b-0888-4a83-8523-0239ceb7445e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:38.263580 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275a28b-0888-4a83-8523-0239ceb7445e None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:38.263964 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275a28b-0888-4a83-8523-0239ceb7445e None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:38.264338 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275a28b-0888-4a83-8523-0239ceb7445e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:38.266977 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 259/527] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:04:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:38.273705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a79e5e-5d48-4ccb-b659-24c0dacf4a6a None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:38.278515 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275a28b-0888-4a83-8523-0239ceb7445e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:38.280169 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275a28b-0888-4a83-8523-0239ceb7445e None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:38.294498 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-6275a28b-0888-4a83-8523-0239ceb7445e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:38.294498 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:38.294498 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:38.294498 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:38.294498 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:38.294498 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:38.294498 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:38.294498 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:38.294498 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:38.294498 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:38.294498 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:38.294498 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:38.294498 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:04:38.294498 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:04:38.294498 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:04:38.295600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:04:38.295600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:38.295600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:38.295600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:38.295600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:38.295600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:38.295600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:38.295600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:38.295600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:38.295600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:38.295600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:38.295600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:38.295600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:38.295600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:38.295600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:38.295600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:38.295600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:38.296671 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:04:38.296671 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:04:38.296671 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:04:38.296671 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:04:38.296671 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:04:38.296671 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:04:38.296671 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:38.296671 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:38.298151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 269/528] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:38.303160 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275a28b-0888-4a83-8523-0239ceb7445e None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:38.356772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:38.391661 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:38.417376 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a79e5e-5d48-4ccb-b659-24c0dacf4a6a None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:38.430731 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275a28b-0888-4a83-8523-0239ceb7445e None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:38.462952 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9c754-802a-4e0c-b98c-7ebe3cfb10bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:38.463620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9c754-802a-4e0c-b98c-7ebe3cfb10bd None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:38.464135 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9c754-802a-4e0c-b98c-7ebe3cfb10bd None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:38.464426 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9c754-802a-4e0c-b98c-7ebe3cfb10bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:38.465236 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9c754-802a-4e0c-b98c-7ebe3cfb10bd None admin] RBAC: Adding query filter params (role.id=2889c6a70cf04dfda4618a8374822c11, scope.project.id=11f4749185bf4adba9ae3cf927b6880b, user.id=a13ee61417bf4b1696004d6d73cf2299) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:38.465552 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9c754-802a-4e0c-b98c-7ebe3cfb10bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:38.467900 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9c754-802a-4e0c-b98c-7ebe3cfb10bd None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:38.471228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fa784-c1a5-4882-9da6-4b095584d5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:38.472308 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fa784-c1a5-4882-9da6-4b095584d5c8 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:38.472894 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fa784-c1a5-4882-9da6-4b095584d5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:38.473369 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fa784-c1a5-4882-9da6-4b095584d5c8 None admin] PATH_INFO: `/v3/projects` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:38.474701 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fa784-c1a5-4882-9da6-4b095584d5c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:38.474811 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 260/529] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:04:38 2022] GET /identity/v3/role_assignments?user.id=a13ee61417bf4b1696004d6d73cf2299&scope.project.id=11f4749185bf4adba9ae3cf927b6880b&role.id=2889c6a70cf04dfda4618a8374822c11 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:38.476785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fa784-c1a5-4882-9da6-4b095584d5c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:38.483308 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fa784-c1a5-4882-9da6-4b095584d5c8 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:38.495574 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 270/530] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:04:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:38.503872 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9c754-802a-4e0c-b98c-7ebe3cfb10bd None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:38.626844 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9c754-802a-4e0c-b98c-7ebe3cfb10bd None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:38.676887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171fc5c-9e2f-45af-88b6-38802de05063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:38.677090 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171fc5c-9e2f-45af-88b6-38802de05063 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:38.677340 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171fc5c-9e2f-45af-88b6-38802de05063 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:38.677620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171fc5c-9e2f-45af-88b6-38802de05063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:38.678406 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171fc5c-9e2f-45af-88b6-38802de05063 None admin] RBAC: Adding query filter params (role.id=2889c6a70cf04dfda4618a8374822c11, scope.project.id=11f4749185bf4adba9ae3cf927b6880b, user.id=bd087e64f5714585a53556a8dda546e9) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:38.678718 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171fc5c-9e2f-45af-88b6-38802de05063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:38.680803 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171fc5c-9e2f-45af-88b6-38802de05063 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:38.692569 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 261/531] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:04:38 2022] GET /identity/v3/role_assignments?user.id=bd087e64f5714585a53556a8dda546e9&scope.project.id=11f4749185bf4adba9ae3cf927b6880b&role.id=2889c6a70cf04dfda4618a8374822c11 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:40.135957 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27be52a-569d-49c6-bb00-a9c8ff0eaa16 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:40.136761 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27be52a-569d-49c6-bb00-a9c8ff0eaa16 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:40.136761 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27be52a-569d-49c6-bb00-a9c8ff0eaa16 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:40.138332 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 271/532] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:40.143789 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e80c71-0062-41d5-8eb1-d00e3cb338b7 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:40.144226 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e80c71-0062-41d5-8eb1-d00e3cb338b7 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:40.144383 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e80c71-0062-41d5-8eb1-d00e3cb338b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:40.164237 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-50e80c71-0062-41d5-8eb1-d00e3cb338b7 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:40.165621 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-50e80c71-0062-41d5-8eb1-d00e3cb338b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:40.169705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:40.248646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 262/533] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:40.272654 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27be52a-569d-49c6-bb00-a9c8ff0eaa16 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:40.385435 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27be52a-569d-49c6-bb00-a9c8ff0eaa16 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:40.388346 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:40.405628 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de73c6-473d-454c-aab0-63ab9e4a2796 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:40.406345 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de73c6-473d-454c-aab0-63ab9e4a2796 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:40.406853 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de73c6-473d-454c-aab0-63ab9e4a2796 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:40.408887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 263/534] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:40.416646 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473d0d7-f0f9-4c01-a39f-d0f32647269c None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:40.416939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473d0d7-f0f9-4c01-a39f-d0f32647269c None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:40.417223 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473d0d7-f0f9-4c01-a39f-d0f32647269c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:40.424753 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b307c-d1f8-4324-a172-bdc1165a36c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:40.425668 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b307c-d1f8-4324-a172-bdc1165a36c8 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:40.426129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b307c-d1f8-4324-a172-bdc1165a36c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:40.426408 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b307c-d1f8-4324-a172-bdc1165a36c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:40.438230 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b307c-d1f8-4324-a172-bdc1165a36c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:40.439868 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-8473d0d7-f0f9-4c01-a39f-d0f32647269c None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:40.441309 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-8473d0d7-f0f9-4c01-a39f-d0f32647269c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:40.443207 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-ea7b307c-d1f8-4324-a172-bdc1165a36c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:40.443207 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:40.443207 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:40.443207 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:40.443207 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:40.443207 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:40.443207 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:40.443207 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:40.443207 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:40.443207 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:40.443207 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:40.443207 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:40.443207 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:40.443207 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:40.443207 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:40.443207 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:40.444129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:40.444129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:40.444129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:40.444129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:40.444129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:40.444129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:40.444129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:40.444129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:40.444129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:40.444129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:40.444129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:40.444129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:40.444129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:40.444129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:40.444129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:40.444129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:40.445311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:40.445311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:40.445311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:40.445311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:40.445311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:40.445311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:40.445311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:40.445311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:40.445311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:40.445311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:40.445311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:40.445311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:40.445311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 272/535] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Jul 28 11:04:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:40.450643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b307c-d1f8-4324-a172-bdc1165a36c8 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:40.543612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 264/536] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:04:40.565033 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473d0d7-f0f9-4c01-a39f-d0f32647269c None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:40.579777 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b307c-d1f8-4324-a172-bdc1165a36c8 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:40.619159 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7af9b-a3ab-4acf-9f79-d8d46dc631af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:40.619830 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7af9b-a3ab-4acf-9f79-d8d46dc631af None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:40.620108 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7af9b-a3ab-4acf-9f79-d8d46dc631af None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:40.620388 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7af9b-a3ab-4acf-9f79-d8d46dc631af None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:40.621238 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7af9b-a3ab-4acf-9f79-d8d46dc631af None admin] RBAC: Adding query filter params (name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:40.621578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7af9b-a3ab-4acf-9f79-d8d46dc631af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:40.623944 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7af9b-a3ab-4acf-9f79-d8d46dc631af None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:40.646006 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 273/537] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Jul 28 11:04:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:40.648501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7af9b-a3ab-4acf-9f79-d8d46dc631af None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:40.663013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:40.702076 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:40.709108 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473d0d7-f0f9-4c01-a39f-d0f32647269c None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:40.753963 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc6acc-f656-4801-b2df-b6c327f4b883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:40.755325 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc6acc-f656-4801-b2df-b6c327f4b883 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:40.755836 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc6acc-f656-4801-b2df-b6c327f4b883 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:40.756754 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc6acc-f656-4801-b2df-b6c327f4b883 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:40.771171 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc6acc-f656-4801-b2df-b6c327f4b883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:40.780197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-a9cc6acc-f656-4801-b2df-b6c327f4b883 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:40.780197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:40.780197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:40.780197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:40.780197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:40.780197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:40.780197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:40.780197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:40.780197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:40.780197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:40.780197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:40.780197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:40.780197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:40.780197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:40.780197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:40.780197 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:40.781093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:40.781093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:40.781093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:40.781093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:40.781093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:40.781093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:40.781093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:40.781093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:40.781093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:40.781093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:40.781093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:40.781093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:40.781093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:40.781093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:40.781093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:40.781093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:40.781878 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:40.781878 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:40.781878 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:40.781878 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:40.781878 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:40.781878 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:40.781878 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:40.781878 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:40.781878 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:40.781878 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:40.781878 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:40.781878 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:40.790689 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 265/538] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Jul 28 11:04:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:40.796574 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc6acc-f656-4801-b2df-b6c327f4b883 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:40.839292 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7af9b-a3ab-4acf-9f79-d8d46dc631af None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:40.883745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ff122-5acb-4e8d-8c62-8457d3ac4134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:40.884419 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ff122-5acb-4e8d-8c62-8457d3ac4134 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:40.884703 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ff122-5acb-4e8d-8c62-8457d3ac4134 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:40.884979 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ff122-5acb-4e8d-8c62-8457d3ac4134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:40.898238 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ff122-5acb-4e8d-8c62-8457d3ac4134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:40.899965 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ff122-5acb-4e8d-8c62-8457d3ac4134 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:40.917388 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-830ff122-5acb-4e8d-8c62-8457d3ac4134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:40.917388 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:40.917388 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:40.917388 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:40.917388 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:40.917388 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:40.917388 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:40.917388 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:40.917388 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:40.917388 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:40.917388 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:40.917388 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:40.917388 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:40.917388 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:40.917388 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:40.918320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:40.918320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:40.918320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:40.918320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:40.918320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:40.918320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:40.918320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:40.918320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:40.918320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:40.918320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:40.918320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:40.918320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:40.918320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:40.918320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:40.918320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:40.918320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:40.918320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:40.919162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:40.919162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:40.919162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:40.919162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:40.919162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 274/539] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:40.919963 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d1744-3fcc-47be-83b8-89496bb6556d None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:40.920171 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d1744-3fcc-47be-83b8-89496bb6556d None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:40.920446 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d1744-3fcc-47be-83b8-89496bb6556d None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:40.925866 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 275/540] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:40.925866 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d1744-3fcc-47be-83b8-89496bb6556d None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:40.943038 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc6acc-f656-4801-b2df-b6c327f4b883 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:40.984273 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:40.990954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fdc90-bfae-4217-a043-b6db5b59ab97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:40.991749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fdc90-bfae-4217-a043-b6db5b59ab97 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:40.992035 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fdc90-bfae-4217-a043-b6db5b59ab97 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:40.992323 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fdc90-bfae-4217-a043-b6db5b59ab97 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:40.993046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fdc90-bfae-4217-a043-b6db5b59ab97 None admin] RBAC: Adding query filter params (name=service) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:40.993439 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fdc90-bfae-4217-a043-b6db5b59ab97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:40.994964 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fdc90-bfae-4217-a043-b6db5b59ab97 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:41.003772 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 266/541] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Jul 28 11:04:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:41.009526 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21465564-a246-47d4-846f-379ba3a3e0e8 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:41.009769 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21465564-a246-47d4-846f-379ba3a3e0e8 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:41.010032 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21465564-a246-47d4-846f-379ba3a3e0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:41.028310 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:41.030342 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-21465564-a246-47d4-846f-379ba3a3e0e8 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:41.031827 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-21465564-a246-47d4-846f-379ba3a3e0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:41.055174 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d1744-3fcc-47be-83b8-89496bb6556d None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:41.090927 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a8f6c-cfb9-41c4-a1a6-a2d6d3b09767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:41.092038 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a8f6c-cfb9-41c4-a1a6-a2d6d3b09767 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:41.092316 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a8f6c-cfb9-41c4-a1a6-a2d6d3b09767 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:41.092752 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a8f6c-cfb9-41c4-a1a6-a2d6d3b09767 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:41.093452 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a8f6c-cfb9-41c4-a1a6-a2d6d3b09767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:41.093840 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a8f6c-cfb9-41c4-a1a6-a2d6d3b09767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:41.095142 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a8f6c-cfb9-41c4-a1a6-a2d6d3b09767 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:41.105359 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 267/542] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:41.106251 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21465564-a246-47d4-846f-379ba3a3e0e8 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:41.112212 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 276/543] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:41.113400 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af357c-4451-4910-b0a9-ed4083a09d70 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:41.113711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af357c-4451-4910-b0a9-ed4083a09d70 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:41.113965 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af357c-4451-4910-b0a9-ed4083a09d70 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:41.115222 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 277/544] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:41.115921 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af357c-4451-4910-b0a9-ed4083a09d70 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:41.224019 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21465564-a246-47d4-846f-379ba3a3e0e8 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:41.228951 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af357c-4451-4910-b0a9-ed4083a09d70 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:41.247337 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:41.259800 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349a0dd-a468-403f-8761-d220936f6495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:41.260443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349a0dd-a468-403f-8761-d220936f6495 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:41.260730 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349a0dd-a468-403f-8761-d220936f6495 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:41.261285 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349a0dd-a468-403f-8761-d220936f6495 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:41.264314 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f646724-9a99-482a-83a7-faed63a60bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:41.264957 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f646724-9a99-482a-83a7-faed63a60bec None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:41.265240 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f646724-9a99-482a-83a7-faed63a60bec None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:41.265516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f646724-9a99-482a-83a7-faed63a60bec None admin] PATH_INFO: `/v3/users/nova` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:41.271814 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349a0dd-a468-403f-8761-d220936f6495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:41.273863 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349a0dd-a468-403f-8761-d220936f6495 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:41.273974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f646724-9a99-482a-83a7-faed63a60bec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:41.275375 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f646724-9a99-482a-83a7-faed63a60bec None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:41.277244 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:41.289439 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-7f646724-9a99-482a-83a7-faed63a60bec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 11:04:41.289439 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:41.289439 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:41.289439 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:41.289439 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:41.289439 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:41.289439 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:41.289439 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:41.289439 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:41.289439 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:41.289439 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:41.289439 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:41.289439 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:04:41.289439 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:04:41.289439 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:04:41.289439 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:04:41.290457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:41.290457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:41.290457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:04:41.290457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:41.290457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:04:41.290457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:41.290457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:41.290457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:41.290457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:41.290457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:41.290457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:41.290457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:41.290457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:41.290457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:41.290457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:41.290457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:41.290457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:41.290457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:41.291672 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:41.291672 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:41.291672 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:04:41.291672 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:04:41.291672 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:04:41.291672 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:04:41.291672 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:04:41.291672 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:04:41.291672 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 11:04:41.291672 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:41.292367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-5349a0dd-a468-403f-8761-d220936f6495 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:41.292367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:41.292367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:41.292367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:41.292367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:41.292367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:41.292367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:41.292367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:41.292367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:41.292367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:41.292367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:41.292367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:41.292367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:41.292367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:41.292367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:41.293612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:41.293612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:41.293612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:41.293612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:41.293612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:41.293612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:41.293612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:41.293612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:41.293612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:41.293612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:41.293612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:41.293612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:41.293612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:41.293612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:41.293612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:41.293612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:41.293612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:41.294481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:41.294481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:41.294481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:41.294481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:41.294696 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 278/545] 10.222.0.71 () {56 vars in 1093 bytes} [Thu Jul 28 11:04:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:41.294763 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 268/546] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:41.294763 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349a0dd-a468-403f-8761-d220936f6495 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:41.296257 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeaa19-f46e-4f96-8750-8c252adb8ba7 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:41.296545 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeaa19-f46e-4f96-8750-8c252adb8ba7 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:41.296823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeaa19-f46e-4f96-8750-8c252adb8ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:41.317702 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-8bdeaa19-f46e-4f96-8750-8c252adb8ba7 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:41.318921 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-8bdeaa19-f46e-4f96-8750-8c252adb8ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:41.394794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 279/547] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:41.395685 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeaa19-f46e-4f96-8750-8c252adb8ba7 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:41.402129 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349a0dd-a468-403f-8761-d220936f6495 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:41.446030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fa4ef-60fb-4b4d-8643-0b6cc14bc372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:41.446680 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fa4ef-60fb-4b4d-8643-0b6cc14bc372 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:41.446968 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fa4ef-60fb-4b4d-8643-0b6cc14bc372 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:41.447287 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fa4ef-60fb-4b4d-8643-0b6cc14bc372 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:41.458363 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fa4ef-60fb-4b4d-8643-0b6cc14bc372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:41.464568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-776fa4ef-60fb-4b4d-8643-0b6cc14bc372 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:41.464568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:41.464568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:41.464568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:41.464568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:41.464568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:41.464568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:41.464568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:41.464568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:41.464568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:41.464568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:41.464568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:41.464568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:41.464568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:41.464568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:41.464568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:41.465664 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:41.465664 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:41.465664 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:41.465664 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:41.465664 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:41.465664 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:41.465664 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:41.465664 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:41.465664 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:41.465664 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:41.465664 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:41.465664 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:41.465664 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:41.465664 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:41.465664 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:41.465664 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:41.466636 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:41.466636 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:41.466636 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:41.466636 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:41.466636 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:41.466636 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:41.466636 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:41.466636 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:41.466636 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:41.466636 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:41.466636 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:41.466636 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:41.470741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 269/548] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Jul 28 11:04:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:41.471746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fa4ef-60fb-4b4d-8643-0b6cc14bc372 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:41.510568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:41.514511 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeaa19-f46e-4f96-8750-8c252adb8ba7 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:41.541935 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:41.550725 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fcf1be-2064-4e89-a19d-947fdcd31310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:41.551398 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcf1be-2064-4e89-a19d-947fdcd31310 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:41.551678 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcf1be-2064-4e89-a19d-947fdcd31310 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:41.551957 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcf1be-2064-4e89-a19d-947fdcd31310 None admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:41.552763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fcf1be-2064-4e89-a19d-947fdcd31310 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:41.553074 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fcf1be-2064-4e89-a19d-947fdcd31310 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:41.554572 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fcf1be-2064-4e89-a19d-947fdcd31310 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:41.573980 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 280/549] 10.222.0.71 () {56 vars in 1133 bytes} [Thu Jul 28 11:04:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:41.573980 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fcf1be-2064-4e89-a19d-947fdcd31310 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:41.586898 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fa4ef-60fb-4b4d-8643-0b6cc14bc372 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:41.624986 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8303cf-6f92-42ce-a3cc-6f88347cd543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:41.625631 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8303cf-6f92-42ce-a3cc-6f88347cd543 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:41.625915 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8303cf-6f92-42ce-a3cc-6f88347cd543 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:41.626195 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8303cf-6f92-42ce-a3cc-6f88347cd543 None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:41.626912 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8303cf-6f92-42ce-a3cc-6f88347cd543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:41.627217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8303cf-6f92-42ce-a3cc-6f88347cd543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:41.628684 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8303cf-6f92-42ce-a3cc-6f88347cd543 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:41.643112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 270/550] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:41.644349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8303cf-6f92-42ce-a3cc-6f88347cd543 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:41.685294 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fcf1be-2064-4e89-a19d-947fdcd31310 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:41.725142 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d9292-db54-42f8-b658-f56ca64746ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:41.725787 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d9292-db54-42f8-b658-f56ca64746ad None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:41.726073 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d9292-db54-42f8-b658-f56ca64746ad None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:41.726444 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d9292-db54-42f8-b658-f56ca64746ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:41.742075 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d9292-db54-42f8-b658-f56ca64746ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:41.747229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-8a8d9292-db54-42f8-b658-f56ca64746ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:41.747229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:41.747229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:41.747229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:41.747229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:41.747229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:41.747229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:41.747229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:41.747229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:41.747229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:41.747229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:41.747229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:41.747229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:41.747229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:41.747229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:41.747229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:41.748378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:41.748378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:41.748378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:41.748378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:41.748378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:41.748378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:41.748378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:41.748378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:41.748378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:41.748378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:41.748378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:41.748378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:41.748378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:41.748378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:41.748378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:41.748378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:41.749373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:41.749373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:41.749373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:41.749373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:41.749373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:41.749373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:41.749373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:41.749373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:41.749373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:41.749373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:41.749373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:41.749373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:41.749373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 281/551] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Jul 28 11:04:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:41.749373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d9292-db54-42f8-b658-f56ca64746ad None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:41.756090 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:41.765224 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8303cf-6f92-42ce-a3cc-6f88347cd543 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:41.799143 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:41.802936 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30c38b-52c6-4cc0-9e38-6aa68c515c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:41.803605 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c38b-52c6-4cc0-9e38-6aa68c515c84 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:41.803882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c38b-52c6-4cc0-9e38-6aa68c515c84 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:41.804699 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c38b-52c6-4cc0-9e38-6aa68c515c84 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:41.805422 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30c38b-52c6-4cc0-9e38-6aa68c515c84 None admin] RBAC: Adding query filter params (name=service) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:41.805726 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30c38b-52c6-4cc0-9e38-6aa68c515c84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:41.807114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30c38b-52c6-4cc0-9e38-6aa68c515c84 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:41.815821 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 271/552] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Jul 28 11:04:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:41.816783 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30c38b-52c6-4cc0-9e38-6aa68c515c84 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:41.859124 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d9292-db54-42f8-b658-f56ca64746ad None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:41.895170 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd9102-1fd2-449b-a99f-5add11cffb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:41.895843 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd9102-1fd2-449b-a99f-5add11cffb82 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:41.896123 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd9102-1fd2-449b-a99f-5add11cffb82 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:41.896397 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd9102-1fd2-449b-a99f-5add11cffb82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:41.907591 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd9102-1fd2-449b-a99f-5add11cffb82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:41.909116 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd9102-1fd2-449b-a99f-5add11cffb82 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:41.922750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30c38b-52c6-4cc0-9e38-6aa68c515c84 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:41.924014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-32dd9102-1fd2-449b-a99f-5add11cffb82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:41.924014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:41.924014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:41.924014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:41.924014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:41.924014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:41.924014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:41.924014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:41.924014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:41.924014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:41.924014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:41.924014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:41.924014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:41.924014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:41.924014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:41.925043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:41.925043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:41.925043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:41.925043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:41.925043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:41.925043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:41.925043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:41.925043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:41.925043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:41.925043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:41.925043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:41.925043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:41.925043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:41.925043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:41.925043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:41.925043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:41.925043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:41.926091 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:41.926091 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:41.926091 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:41.926091 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:41.926091 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 282/553] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:41.926091 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd9102-1fd2-449b-a99f-5add11cffb82 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:41.960693 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02237f80-1e85-4bc4-8c97-33f017783794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:41.961445 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02237f80-1e85-4bc4-8c97-33f017783794 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:41.962001 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02237f80-1e85-4bc4-8c97-33f017783794 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:41.962289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02237f80-1e85-4bc4-8c97-33f017783794 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:41.970301 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02237f80-1e85-4bc4-8c97-33f017783794 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:41.971808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02237f80-1e85-4bc4-8c97-33f017783794 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:41.984091 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-02237f80-1e85-4bc4-8c97-33f017783794 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 11:04:41.984091 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:41.984091 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:41.984091 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:41.984091 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:41.984091 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:41.984091 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:41.984091 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:41.984091 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:41.984091 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:41.984091 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:41.984091 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:41.984091 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:04:41.984091 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:04:41.984091 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:04:41.984091 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:04:41.985230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:41.985230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:41.985230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:04:41.985230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:41.985230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:04:41.985230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:41.985230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:41.985230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:41.985230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:41.985230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:41.985230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:41.985230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:41.985230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:41.985230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:41.985230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:41.985230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:41.985230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:41.985230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:41.986144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:41.986144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:41.986144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:04:41.986144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:04:41.986144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:04:41.986144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:04:41.986144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:04:41.986144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:04:41.986144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 11:04:41.986144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:41.986144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 272/554] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:41.986700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02237f80-1e85-4bc4-8c97-33f017783794 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:42.008818 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:42.039578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:42.043603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd9102-1fd2-449b-a99f-5add11cffb82 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:42.079909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86ab1a-b58e-4e52-b07f-6f1bd76d13e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:42.080652 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86ab1a-b58e-4e52-b07f-6f1bd76d13e4 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:42.080940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86ab1a-b58e-4e52-b07f-6f1bd76d13e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:42.081223 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86ab1a-b58e-4e52-b07f-6f1bd76d13e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:42.081943 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86ab1a-b58e-4e52-b07f-6f1bd76d13e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:42.082253 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86ab1a-b58e-4e52-b07f-6f1bd76d13e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:42.083670 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86ab1a-b58e-4e52-b07f-6f1bd76d13e4 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:42.092486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 283/555] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Jul 28 11:04:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:42.093823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86ab1a-b58e-4e52-b07f-6f1bd76d13e4 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:42.103838 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02237f80-1e85-4bc4-8c97-33f017783794 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:42.142772 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ba5af-4f3b-40f7-9ef2-278fc6e4f1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:42.143459 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ba5af-4f3b-40f7-9ef2-278fc6e4f1ba None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:42.143746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ba5af-4f3b-40f7-9ef2-278fc6e4f1ba None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:42.144020 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ba5af-4f3b-40f7-9ef2-278fc6e4f1ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:42.154935 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ba5af-4f3b-40f7-9ef2-278fc6e4f1ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:42.156430 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ba5af-4f3b-40f7-9ef2-278fc6e4f1ba None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:42.172163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-240ba5af-4f3b-40f7-9ef2-278fc6e4f1ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:42.172163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:42.172163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:42.172163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:42.172163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:42.172163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:42.172163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:42.172163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:42.172163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:42.172163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:42.172163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:42.172163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:42.172163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:42.172163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:42.172163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:42.173262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:42.173262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:42.173262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:42.173262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:42.173262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:42.173262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:42.173262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:42.173262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:42.173262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:42.173262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:42.173262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:42.173262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:42.173262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:42.173262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:42.173262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:42.173262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:42.173262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:42.174683 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:42.174683 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:42.174683 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:42.174683 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:42.174683 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 273/556] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:42.174683 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ba5af-4f3b-40f7-9ef2-278fc6e4f1ba None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:42.201574 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86ab1a-b58e-4e52-b07f-6f1bd76d13e4 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:42.236336 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088b8f8-5188-4493-a94e-92193e6fc450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:42.237019 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088b8f8-5188-4493-a94e-92193e6fc450 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:42.237219 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088b8f8-5188-4493-a94e-92193e6fc450 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:42.237494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088b8f8-5188-4493-a94e-92193e6fc450 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:42.238191 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088b8f8-5188-4493-a94e-92193e6fc450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:42.238499 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088b8f8-5188-4493-a94e-92193e6fc450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:42.239888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088b8f8-5188-4493-a94e-92193e6fc450 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:42.250745 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:42.252295 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 284/557] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:42.253194 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088b8f8-5188-4493-a94e-92193e6fc450 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:42.274021 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:42.285207 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ba5af-4f3b-40f7-9ef2-278fc6e4f1ba None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:42.320470 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1721d-5ee9-40e7-b583-9f05900e8714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:42.321106 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1721d-5ee9-40e7-b583-9f05900e8714 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:42.321393 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1721d-5ee9-40e7-b583-9f05900e8714 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:42.321670 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1721d-5ee9-40e7-b583-9f05900e8714 None admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:42.322475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1721d-5ee9-40e7-b583-9f05900e8714 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:42.322787 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1721d-5ee9-40e7-b583-9f05900e8714 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:42.324372 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1721d-5ee9-40e7-b583-9f05900e8714 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:42.342266 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 274/558] 10.222.0.71 () {56 vars in 1137 bytes} [Thu Jul 28 11:04:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:42.343369 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1721d-5ee9-40e7-b583-9f05900e8714 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:42.359414 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088b8f8-5188-4493-a94e-92193e6fc450 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:42.395145 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febac96f-3b32-43de-9f9e-6961753915c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:42.395824 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febac96f-3b32-43de-9f9e-6961753915c6 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:42.396108 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febac96f-3b32-43de-9f9e-6961753915c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:42.396387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febac96f-3b32-43de-9f9e-6961753915c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:42.408322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febac96f-3b32-43de-9f9e-6961753915c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:42.409912 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febac96f-3b32-43de-9f9e-6961753915c6 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:42.425562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-febac96f-3b32-43de-9f9e-6961753915c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:42.425562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:42.425562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:42.425562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:42.425562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:42.425562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:42.425562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:42.425562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:42.425562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:42.425562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:42.425562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:42.425562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:42.425562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:42.425562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:42.425562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:42.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:42.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:42.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:42.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:42.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:42.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:42.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:42.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:42.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:42.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:42.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:42.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:42.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:42.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:42.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:42.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:42.427138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:42.428261 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:42.428261 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:42.428261 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:42.428261 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:42.431419 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 285/559] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:42.432611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febac96f-3b32-43de-9f9e-6961753915c6 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:42.446475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1721d-5ee9-40e7-b583-9f05900e8714 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:42.473259 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:42.487877 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7067b0-4342-4a8c-99e3-78740ac60df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:42.488608 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7067b0-4342-4a8c-99e3-78740ac60df4 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:42.488885 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7067b0-4342-4a8c-99e3-78740ac60df4 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:42.493039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7067b0-4342-4a8c-99e3-78740ac60df4 None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:42.493039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7067b0-4342-4a8c-99e3-78740ac60df4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:42.493039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7067b0-4342-4a8c-99e3-78740ac60df4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:42.493039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7067b0-4342-4a8c-99e3-78740ac60df4 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:42.503663 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 275/560] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:42.504482 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7067b0-4342-4a8c-99e3-78740ac60df4 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:42.509604 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:42.541730 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febac96f-3b32-43de-9f9e-6961753915c6 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:42.577372 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7355a2-8e5a-4e54-ac9c-c4b4195c33fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:42.577967 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7355a2-8e5a-4e54-ac9c-c4b4195c33fb None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:42.578253 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7355a2-8e5a-4e54-ac9c-c4b4195c33fb None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:42.578533 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7355a2-8e5a-4e54-ac9c-c4b4195c33fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:42.586316 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7355a2-8e5a-4e54-ac9c-c4b4195c33fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:42.587826 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7355a2-8e5a-4e54-ac9c-c4b4195c33fb None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:42.599562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-1d7355a2-8e5a-4e54-ac9c-c4b4195c33fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:42.599562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:42.599562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:42.599562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:42.599562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:42.599562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:42.599562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:42.599562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:42.599562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:42.599562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:42.599562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:42.599562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:42.599562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:04:42.599562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:04:42.599562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:04:42.602185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:04:42.602185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:42.602185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:42.602185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:42.602185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:42.602185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:42.602185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:42.602185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:42.602185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:42.602185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:42.602185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:42.602185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:42.602185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:42.602185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:42.602185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:42.602185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:42.602185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:42.604204 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:04:42.604204 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:04:42.604204 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:04:42.604204 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:04:42.604204 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:04:42.604204 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:04:42.604204 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:42.604204 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:42.604204 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 286/561] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:42.604204 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7355a2-8e5a-4e54-ac9c-c4b4195c33fb None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:42.629485 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7067b0-4342-4a8c-99e3-78740ac60df4 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:42.665045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cfa2e-106d-4096-a235-e016e0acd456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:42.665687 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cfa2e-106d-4096-a235-e016e0acd456 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:42.665972 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cfa2e-106d-4096-a235-e016e0acd456 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:42.666227 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cfa2e-106d-4096-a235-e016e0acd456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:42.677204 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cfa2e-106d-4096-a235-e016e0acd456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:42.678700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cfa2e-106d-4096-a235-e016e0acd456 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:42.694082 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-2e6cfa2e-106d-4096-a235-e016e0acd456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:42.694082 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:42.694082 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:42.694082 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:42.694082 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:42.694082 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:42.694082 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:42.694082 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:42.694082 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:42.694082 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:42.694082 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:42.694082 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:42.694082 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:42.694082 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:42.694082 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:42.695080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:42.695080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:42.695080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:42.695080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:42.695080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:42.695080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:42.695080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:42.695080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:42.695080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:42.695080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:42.695080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:42.695080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:42.695080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:42.695080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:42.695080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:42.695080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:42.695080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:42.701259 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:42.701259 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:42.701259 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:42.701259 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:42.701259 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 276/562] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:42.701259 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cfa2e-106d-4096-a235-e016e0acd456 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:42.712066 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7355a2-8e5a-4e54-ac9c-c4b4195c33fb None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:42.741540 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:42.743318 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:42.750384 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e4a29-9e82-4f04-ad2d-f515cacde2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:42.751091 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e4a29-9e82-4f04-ad2d-f515cacde2c3 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:42.751421 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e4a29-9e82-4f04-ad2d-f515cacde2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:42.751702 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e4a29-9e82-4f04-ad2d-f515cacde2c3 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:42.752473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e4a29-9e82-4f04-ad2d-f515cacde2c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:42.752786 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e4a29-9e82-4f04-ad2d-f515cacde2c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:42.754226 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e4a29-9e82-4f04-ad2d-f515cacde2c3 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:42.768240 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 287/563] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:42.769110 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e4a29-9e82-4f04-ad2d-f515cacde2c3 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:42.809496 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cfa2e-106d-4096-a235-e016e0acd456 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:42.845786 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e13def-ff6b-4aba-912e-2f795cc135a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:42.846358 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e13def-ff6b-4aba-912e-2f795cc135a7 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:42.846641 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e13def-ff6b-4aba-912e-2f795cc135a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:42.846919 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e13def-ff6b-4aba-912e-2f795cc135a7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:42.855076 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e13def-ff6b-4aba-912e-2f795cc135a7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:42.856578 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e13def-ff6b-4aba-912e-2f795cc135a7 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:42.868446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-f1e13def-ff6b-4aba-912e-2f795cc135a7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 11:04:42.868446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:42.868446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:42.868446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:42.868446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:42.868446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:42.868446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:42.868446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:42.868446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:42.868446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:42.868446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:42.868446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:42.868446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:04:42.868446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:04:42.868446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:04:42.868446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:04:42.869566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:42.869566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:42.869566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:04:42.869566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:42.869566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:04:42.869566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:42.869566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:42.869566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:42.869566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:42.869566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:42.869566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:42.869566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:42.869566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:42.869566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:42.869566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:42.869566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:42.869566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:42.869566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:42.870560 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:42.870560 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:42.870560 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:04:42.870560 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:04:42.870560 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:04:42.870560 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:04:42.870560 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:04:42.870560 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:04:42.870560 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 11:04:42.870560 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:42.870560 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 277/564] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:42.870560 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e13def-ff6b-4aba-912e-2f795cc135a7 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:42.877057 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e4a29-9e82-4f04-ad2d-f515cacde2c3 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:42.913179 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9a973-00eb-4cbf-864e-ef3139b356fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:42.913853 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9a973-00eb-4cbf-864e-ef3139b356fb None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:42.914130 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9a973-00eb-4cbf-864e-ef3139b356fb None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:42.914402 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9a973-00eb-4cbf-864e-ef3139b356fb None admin] PATH_INFO: `/v3/projects` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:42.915160 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9a973-00eb-4cbf-864e-ef3139b356fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:42.915488 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9a973-00eb-4cbf-864e-ef3139b356fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:42.916914 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9a973-00eb-4cbf-864e-ef3139b356fb None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:42.929268 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 288/565] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:04:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:42.930472 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9a973-00eb-4cbf-864e-ef3139b356fb None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:42.979574 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:42.983404 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e13def-ff6b-4aba-912e-2f795cc135a7 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:42.983869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:43.020837 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ed3a2-abed-4d8b-b224-00da1c6fc5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:43.021834 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ed3a2-abed-4d8b-b224-00da1c6fc5bf None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:43.022288 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ed3a2-abed-4d8b-b224-00da1c6fc5bf None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:43.022743 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ed3a2-abed-4d8b-b224-00da1c6fc5bf None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:43.024555 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ed3a2-abed-4d8b-b224-00da1c6fc5bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:43.025004 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ed3a2-abed-4d8b-b224-00da1c6fc5bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:43.027290 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ed3a2-abed-4d8b-b224-00da1c6fc5bf None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:43.035874 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9a973-00eb-4cbf-864e-ef3139b356fb None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:43.046007 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 278/566] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:43.046868 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ed3a2-abed-4d8b-b224-00da1c6fc5bf None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:43.071478 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9fb1b-88b0-4bd8-9fe6-d8c6296dd1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:43.072133 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9fb1b-88b0-4bd8-9fe6-d8c6296dd1c3 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:43.072425 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9fb1b-88b0-4bd8-9fe6-d8c6296dd1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:43.072700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9fb1b-88b0-4bd8-9fe6-d8c6296dd1c3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:43.080664 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9fb1b-88b0-4bd8-9fe6-d8c6296dd1c3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:43.082138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9fb1b-88b0-4bd8-9fe6-d8c6296dd1c3 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:43.094215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-18c9fb1b-88b0-4bd8-9fe6-d8c6296dd1c3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 11:04:43.094215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:43.094215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:43.094215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:43.094215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:43.094215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:43.094215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:43.094215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:43.094215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:43.094215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:43.094215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:43.094215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:43.094215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:04:43.094215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:04:43.094215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:04:43.094215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:04:43.095186 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:43.095186 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:43.095186 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:04:43.095186 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:43.095186 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:04:43.095186 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:43.095186 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:43.095186 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:43.095186 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:43.095186 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:43.095186 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:43.095186 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:43.095186 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:43.095186 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:43.095186 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:43.095186 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:43.095186 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:43.095186 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:43.096213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:43.096213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:43.096213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:04:43.096213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:04:43.096213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:04:43.096213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:04:43.096213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:04:43.096213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:04:43.096213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 11:04:43.096213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:43.096213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 289/567] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Jul 28 11:04:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:43.096213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9fb1b-88b0-4bd8-9fe6-d8c6296dd1c3 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:43.155622 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ed3a2-abed-4d8b-b224-00da1c6fc5bf None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:43.195802 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14521562-085c-41a7-87a5-25d6bf8657de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:43.196429 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14521562-085c-41a7-87a5-25d6bf8657de None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:43.196713 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14521562-085c-41a7-87a5-25d6bf8657de None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:43.196985 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14521562-085c-41a7-87a5-25d6bf8657de None admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:43.197784 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14521562-085c-41a7-87a5-25d6bf8657de None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:43.198102 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14521562-085c-41a7-87a5-25d6bf8657de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:43.199740 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14521562-085c-41a7-87a5-25d6bf8657de None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:43.210779 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9fb1b-88b0-4bd8-9fe6-d8c6296dd1c3 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:43.219028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 279/568] 10.222.0.71 () {56 vars in 1137 bytes} [Thu Jul 28 11:04:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:43.219908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14521562-085c-41a7-87a5-25d6bf8657de None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:43.231356 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:43.241181 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:43.258641 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42beeda-2900-4ca2-b00b-8afc5060dcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:43.259350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42beeda-2900-4ca2-b00b-8afc5060dcfc None admin] REQUEST_METHOD: `PUT` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:43.259642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42beeda-2900-4ca2-b00b-8afc5060dcfc None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:43.259920 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42beeda-2900-4ca2-b00b-8afc5060dcfc None admin] PATH_INFO: `/v3/projects/11f4749185bf4adba9ae3cf927b6880b/users/2bf7f66ba696444f8055a498e292a182/roles/2889c6a70cf04dfda4618a8374822c11` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:43.275239 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42beeda-2900-4ca2-b00b-8afc5060dcfc None admin] RBAC: Authorizing `identity:create_grant(project_id=11f4749185bf4adba9ae3cf927b6880b, user_id=2bf7f66ba696444f8055a498e292a182, role_id=2889c6a70cf04dfda4618a8374822c11)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:43.276842 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42beeda-2900-4ca2-b00b-8afc5060dcfc None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:43.289788 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 290/569] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Jul 28 11:04:43 2022] PUT /identity/v3/projects/11f4749185bf4adba9ae3cf927b6880b/users/2bf7f66ba696444f8055a498e292a182/roles/2889c6a70cf04dfda4618a8374822c11 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:04:43.290617 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42beeda-2900-4ca2-b00b-8afc5060dcfc None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:43.339731 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14521562-085c-41a7-87a5-25d6bf8657de None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:43.389640 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afa2ce-2b93-4693-ae15-3c2535eb78e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:43.390744 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afa2ce-2b93-4693-ae15-3c2535eb78e2 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:43.391474 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afa2ce-2b93-4693-ae15-3c2535eb78e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:43.391764 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afa2ce-2b93-4693-ae15-3c2535eb78e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:43.400408 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afa2ce-2b93-4693-ae15-3c2535eb78e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:43.402109 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afa2ce-2b93-4693-ae15-3c2535eb78e2 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:43.416524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-a4afa2ce-2b93-4693-ae15-3c2535eb78e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:43.416524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:43.416524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:43.416524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:43.416524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:43.416524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:43.416524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:43.416524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:43.416524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:43.416524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:43.416524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:43.416524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:43.416524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:04:43.416524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:04:43.416524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:04:43.422749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:04:43.422749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:43.422749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:43.422749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:43.422749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:43.422749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:43.422749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:43.422749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:43.422749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:43.422749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:43.422749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:43.422749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:43.422749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:43.422749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:43.422749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:43.422749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:43.422749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:43.423657 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:04:43.423657 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:04:43.423657 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:04:43.423657 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:04:43.423657 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:04:43.423657 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:04:43.423657 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:43.423657 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:43.423657 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 280/570] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:43.423657 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afa2ce-2b93-4693-ae15-3c2535eb78e2 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:43.442206 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42beeda-2900-4ca2-b00b-8afc5060dcfc None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:43.488130 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768a5ab-af79-4f15-b362-51fde238b758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:43.488809 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768a5ab-af79-4f15-b362-51fde238b758 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:43.489095 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768a5ab-af79-4f15-b362-51fde238b758 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:43.489378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768a5ab-af79-4f15-b362-51fde238b758 None admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:43.490183 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768a5ab-af79-4f15-b362-51fde238b758 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:43.490497 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768a5ab-af79-4f15-b362-51fde238b758 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:43.492591 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768a5ab-af79-4f15-b362-51fde238b758 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:43.513450 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 291/571] 10.222.0.71 () {56 vars in 1139 bytes} [Thu Jul 28 11:04:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:43.514136 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768a5ab-af79-4f15-b362-51fde238b758 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:43.535967 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:43.537133 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:43.564172 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afa2ce-2b93-4693-ae15-3c2535eb78e2 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:43.602471 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595fae4-6aa3-4ddf-8236-4cfb12b3d4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:43.603121 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595fae4-6aa3-4ddf-8236-4cfb12b3d4f4 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:43.603525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595fae4-6aa3-4ddf-8236-4cfb12b3d4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:43.603730 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595fae4-6aa3-4ddf-8236-4cfb12b3d4f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:43.615176 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595fae4-6aa3-4ddf-8236-4cfb12b3d4f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:43.617313 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595fae4-6aa3-4ddf-8236-4cfb12b3d4f4 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:43.632782 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768a5ab-af79-4f15-b362-51fde238b758 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:43.633456 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-f595fae4-6aa3-4ddf-8236-4cfb12b3d4f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:43.633456 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:43.633456 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:43.633456 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:43.633456 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:43.633456 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:43.633456 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:43.633456 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:43.633456 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:43.633456 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:43.633456 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:43.633456 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:43.633456 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:43.633456 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:43.633456 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:43.634286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:43.634286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:43.634286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:43.634286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:43.634286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:43.634286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:43.634286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:43.634286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:43.634286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:43.634286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:43.634286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:43.634286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:43.634286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:43.634286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:43.634286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:43.634286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:43.634286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:43.635173 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:43.635173 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:43.635173 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:43.635173 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:43.635998 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 281/572] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:43.636571 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595fae4-6aa3-4ddf-8236-4cfb12b3d4f4 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:43.671790 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee05f0-7584-46a9-9d20-fa35aa6143fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:43.672424 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee05f0-7584-46a9-9d20-fa35aa6143fa None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:43.672707 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee05f0-7584-46a9-9d20-fa35aa6143fa None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:43.672983 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee05f0-7584-46a9-9d20-fa35aa6143fa None admin] PATH_INFO: `/v3/projects` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:43.673748 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee05f0-7584-46a9-9d20-fa35aa6143fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:43.674053 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee05f0-7584-46a9-9d20-fa35aa6143fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:43.675556 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee05f0-7584-46a9-9d20-fa35aa6143fa None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:43.689432 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 292/573] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:04:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:43.690034 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee05f0-7584-46a9-9d20-fa35aa6143fa None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:43.790243 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595fae4-6aa3-4ddf-8236-4cfb12b3d4f4 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:43.794123 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:43.827575 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee05f0-7584-46a9-9d20-fa35aa6143fa None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:43.839559 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:43.850342 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20c2cd-6d83-4181-9644-9be9a4227c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:43.851549 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20c2cd-6d83-4181-9644-9be9a4227c21 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:43.851841 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20c2cd-6d83-4181-9644-9be9a4227c21 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:43.852124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20c2cd-6d83-4181-9644-9be9a4227c21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:43.867901 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20c2cd-6d83-4181-9644-9be9a4227c21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:43.869511 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20c2cd-6d83-4181-9644-9be9a4227c21 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:43.879378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b899243-0b1c-4e78-b4b6-370feeadaa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:43.880103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b899243-0b1c-4e78-b4b6-370feeadaa3d None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:43.880387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b899243-0b1c-4e78-b4b6-370feeadaa3d None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:43.880664 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b899243-0b1c-4e78-b4b6-370feeadaa3d None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:43.881374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b899243-0b1c-4e78-b4b6-370feeadaa3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:43.881682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b899243-0b1c-4e78-b4b6-370feeadaa3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:43.883148 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b899243-0b1c-4e78-b4b6-370feeadaa3d None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:43.885575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-cb20c2cd-6d83-4181-9644-9be9a4227c21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:43.885575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:43.885575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:43.885575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:43.885575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:43.885575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:43.885575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:43.885575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:43.885575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:43.885575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:43.885575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:43.885575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:43.885575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:43.885575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:43.885575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:43.886736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:43.886736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:43.886736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:43.886736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:43.886736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:43.886736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:43.886736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:43.886736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:43.886736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:43.886736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:43.886736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:43.886736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:43.886736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:43.886736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:43.886736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:43.886736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:43.886736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:43.892595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:43.892595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:43.892595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:43.892595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:43.892595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 282/574] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:43.892595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20c2cd-6d83-4181-9644-9be9a4227c21 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:43.904736 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 293/575] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:43.905597 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b899243-0b1c-4e78-b4b6-370feeadaa3d None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:44.015547 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20c2cd-6d83-4181-9644-9be9a4227c21 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:44.022670 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b899243-0b1c-4e78-b4b6-370feeadaa3d None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:44.067124 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327d7ca-2216-44af-9d4c-32a561d3a392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:44.067801 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327d7ca-2216-44af-9d4c-32a561d3a392 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:44.068088 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327d7ca-2216-44af-9d4c-32a561d3a392 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:44.068391 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327d7ca-2216-44af-9d4c-32a561d3a392 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:44.069079 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327d7ca-2216-44af-9d4c-32a561d3a392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:44.069386 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327d7ca-2216-44af-9d4c-32a561d3a392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:44.070849 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327d7ca-2216-44af-9d4c-32a561d3a392 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:44.081794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:44.089892 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 294/576] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:44.090076 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947234d-3901-4364-a155-6a22832efd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:44.090188 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327d7ca-2216-44af-9d4c-32a561d3a392 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:44.090308 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947234d-3901-4364-a155-6a22832efd4d None admin] REQUEST_METHOD: `PUT` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:44.090308 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947234d-3901-4364-a155-6a22832efd4d None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:44.090308 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947234d-3901-4364-a155-6a22832efd4d None admin] PATH_INFO: `/v3/projects/11f4749185bf4adba9ae3cf927b6880b/users/51f33b105ddb4c81a9ead57fd2d888ac/roles/2889c6a70cf04dfda4618a8374822c11` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:44.116044 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947234d-3901-4364-a155-6a22832efd4d None admin] RBAC: Authorizing `identity:create_grant(project_id=11f4749185bf4adba9ae3cf927b6880b, user_id=51f33b105ddb4c81a9ead57fd2d888ac, role_id=2889c6a70cf04dfda4618a8374822c11)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:44.118950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947234d-3901-4364-a155-6a22832efd4d None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:44.147386 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 283/577] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Jul 28 11:04:43 2022] PUT /identity/v3/projects/11f4749185bf4adba9ae3cf927b6880b/users/51f33b105ddb4c81a9ead57fd2d888ac/roles/2889c6a70cf04dfda4618a8374822c11 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:04:44.147386 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947234d-3901-4364-a155-6a22832efd4d None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:44.183238 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:44.254107 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327d7ca-2216-44af-9d4c-32a561d3a392 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:44.297707 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4a4da-0e3a-4150-b9b2-982d3863deab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:44.301902 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4a4da-0e3a-4150-b9b2-982d3863deab None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:44.301902 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4a4da-0e3a-4150-b9b2-982d3863deab None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:44.301902 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4a4da-0e3a-4150-b9b2-982d3863deab None admin] PATH_INFO: `/v3/projects/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:44.302254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947234d-3901-4364-a155-6a22832efd4d None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:44.310726 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4a4da-0e3a-4150-b9b2-982d3863deab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:44.312600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4a4da-0e3a-4150-b9b2-982d3863deab None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:44.327854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-0bb4a4da-0e3a-4150-b9b2-982d3863deab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:44.327854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:44.327854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:44.327854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:44.327854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:44.327854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:44.327854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:44.327854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:44.327854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:44.327854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:44.327854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:44.327854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:44.327854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:04:44.327854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:04:44.327854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:04:44.328974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:04:44.328974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:44.328974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:44.328974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:44.328974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:44.328974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:44.328974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:44.328974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:44.328974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:44.328974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:44.328974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:44.328974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:44.328974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:44.328974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:44.328974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:44.328974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:44.328974 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:44.330073 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:04:44.330073 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:04:44.330073 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:04:44.330073 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:04:44.330073 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:04:44.330073 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:04:44.330073 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:44.330073 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:44.332084 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 295/578] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:44.337133 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4a4da-0e3a-4150-b9b2-982d3863deab None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:44.358780 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492dd55e-35cb-49b6-bc99-7165b7261579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:44.359565 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dd55e-35cb-49b6-bc99-7165b7261579 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:44.360069 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dd55e-35cb-49b6-bc99-7165b7261579 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:44.360370 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dd55e-35cb-49b6-bc99-7165b7261579 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:44.372386 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492dd55e-35cb-49b6-bc99-7165b7261579 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:44.372894 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492dd55e-35cb-49b6-bc99-7165b7261579 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:44.390734 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-492dd55e-35cb-49b6-bc99-7165b7261579 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:44.390734 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:44.390734 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:44.390734 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:44.390734 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:44.390734 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:44.390734 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:44.390734 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:44.390734 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:44.390734 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:44.390734 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:44.390734 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:44.390734 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:04:44.390734 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:04:44.390734 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:04:44.392003 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:04:44.392003 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:44.392003 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:44.392003 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:44.392003 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:44.392003 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:44.392003 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:44.392003 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:44.392003 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:44.392003 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:44.392003 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:44.392003 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:44.392003 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:44.392003 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:44.392003 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:44.392003 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:44.392003 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:44.393395 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:04:44.393395 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:04:44.393395 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:04:44.393395 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:04:44.393395 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:04:44.393395 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:04:44.393395 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:44.393395 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:44.393395 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 284/579] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:44.400096 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492dd55e-35cb-49b6-bc99-7165b7261579 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:44.447731 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:44.505713 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:44.516339 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492dd55e-35cb-49b6-bc99-7165b7261579 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:44.533618 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4a4da-0e3a-4150-b9b2-982d3863deab None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:44.552107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e956eb8-1c14-4d99-a019-c53a910aaf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:44.552868 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e956eb8-1c14-4d99-a019-c53a910aaf46 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:44.553219 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e956eb8-1c14-4d99-a019-c53a910aaf46 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:44.553565 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e956eb8-1c14-4d99-a019-c53a910aaf46 None admin] PATH_INFO: `/v3/projects` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:44.554959 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e956eb8-1c14-4d99-a019-c53a910aaf46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:44.555366 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e956eb8-1c14-4d99-a019-c53a910aaf46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:44.556894 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e956eb8-1c14-4d99-a019-c53a910aaf46 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:44.570089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 285/580] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:04:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:44.580870 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e956eb8-1c14-4d99-a019-c53a910aaf46 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:44.596882 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7715302-297a-49ed-96a3-549c23869722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:44.597921 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7715302-297a-49ed-96a3-549c23869722 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:44.598385 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7715302-297a-49ed-96a3-549c23869722 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:44.598839 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7715302-297a-49ed-96a3-549c23869722 None admin] PATH_INFO: `/v3/projects` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:44.600208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7715302-297a-49ed-96a3-549c23869722 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:44.600727 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7715302-297a-49ed-96a3-549c23869722 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:44.604079 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7715302-297a-49ed-96a3-549c23869722 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:44.626798 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 296/581] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:04:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:44.632949 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7715302-297a-49ed-96a3-549c23869722 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:44.758404 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e956eb8-1c14-4d99-a019-c53a910aaf46 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:44.762565 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7715302-297a-49ed-96a3-549c23869722 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:44.786350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:44.812367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a9615-9653-45c1-80c0-82ef04b05a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:44.812654 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe522c2-0394-4148-aa05-1df0a7bdfbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:44.813395 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a9615-9653-45c1-80c0-82ef04b05a6a None admin] REQUEST_METHOD: `PUT` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:44.813508 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe522c2-0394-4148-aa05-1df0a7bdfbcf None admin] REQUEST_METHOD: `PUT` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:44.819288 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a9615-9653-45c1-80c0-82ef04b05a6a None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:44.819452 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe522c2-0394-4148-aa05-1df0a7bdfbcf None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:44.819531 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a9615-9653-45c1-80c0-82ef04b05a6a None admin] PATH_INFO: `/v3/projects/11f4749185bf4adba9ae3cf927b6880b/users/bd087e64f5714585a53556a8dda546e9/roles/2889c6a70cf04dfda4618a8374822c11` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:44.819629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe522c2-0394-4148-aa05-1df0a7bdfbcf None admin] PATH_INFO: `/v3/projects/11f4749185bf4adba9ae3cf927b6880b/users/a13ee61417bf4b1696004d6d73cf2299/roles/2889c6a70cf04dfda4618a8374822c11` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:44.836603 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a9615-9653-45c1-80c0-82ef04b05a6a None admin] RBAC: Authorizing `identity:create_grant(project_id=11f4749185bf4adba9ae3cf927b6880b, user_id=bd087e64f5714585a53556a8dda546e9, role_id=2889c6a70cf04dfda4618a8374822c11)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:44.838340 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe522c2-0394-4148-aa05-1df0a7bdfbcf None admin] RBAC: Authorizing `identity:create_grant(project_id=11f4749185bf4adba9ae3cf927b6880b, user_id=a13ee61417bf4b1696004d6d73cf2299, role_id=2889c6a70cf04dfda4618a8374822c11)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:44.838463 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a9615-9653-45c1-80c0-82ef04b05a6a None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:44.840067 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe522c2-0394-4148-aa05-1df0a7bdfbcf None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:44.854666 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 286/582] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Jul 28 11:04:44 2022] PUT /identity/v3/projects/11f4749185bf4adba9ae3cf927b6880b/users/bd087e64f5714585a53556a8dda546e9/roles/2889c6a70cf04dfda4618a8374822c11 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:04:44.855633 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:44.862248 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 297/583] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Jul 28 11:04:44 2022] PUT /identity/v3/projects/11f4749185bf4adba9ae3cf927b6880b/users/a13ee61417bf4b1696004d6d73cf2299/roles/2889c6a70cf04dfda4618a8374822c11 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:04:45.698997 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3f57f-ec94-4398-933d-07d23b23e7c4 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:45.699514 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3f57f-ec94-4398-933d-07d23b23e7c4 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:45.699514 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3f57f-ec94-4398-933d-07d23b23e7c4 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:45.701105 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 287/584] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:45.706677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da05a1-4732-4b95-ba69-1629fcd1b4bd None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:45.707075 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da05a1-4732-4b95-ba69-1629fcd1b4bd None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:45.707242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da05a1-4732-4b95-ba69-1629fcd1b4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:45.725592 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-f1da05a1-4732-4b95-ba69-1629fcd1b4bd None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:45.727108 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-f1da05a1-4732-4b95-ba69-1629fcd1b4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:45.796587 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 298/585] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:04:45.820929 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3f57f-ec94-4398-933d-07d23b23e7c4 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:45.934111 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3f57f-ec94-4398-933d-07d23b23e7c4 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:45.971228 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a76a9-c08c-433d-abc6-3fc33bca21ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:45.972263 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a76a9-c08c-433d-abc6-3fc33bca21ce None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:45.972751 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a76a9-c08c-433d-abc6-3fc33bca21ce None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:45.973225 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a76a9-c08c-433d-abc6-3fc33bca21ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:45.984823 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a76a9-c08c-433d-abc6-3fc33bca21ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:45.990217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-2f3a76a9-c08c-433d-abc6-3fc33bca21ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:45.990217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:45.990217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:45.990217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:45.990217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:45.990217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:45.990217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:45.990217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:45.990217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:45.990217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:45.990217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:45.990217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:45.990217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:45.990217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:45.990217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:45.990217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:45.991133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:45.991133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:45.991133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:45.991133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:45.991133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:45.991133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:45.991133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:45.991133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:45.991133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:45.991133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:45.991133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:45.991133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:45.991133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:45.991133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:45.991133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:45.991133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:45.992070 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:45.992070 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:45.992070 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:45.992070 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:45.992070 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:45.992070 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:45.992070 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:45.992070 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:45.992070 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:45.992070 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:45.992070 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:45.992070 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:45.994834 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 288/586] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Jul 28 11:04:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:46.004075 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da05a1-4732-4b95-ba69-1629fcd1b4bd None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:46.119487 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:46.123861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da05a1-4732-4b95-ba69-1629fcd1b4bd None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:46.162160 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4a384-85d4-4705-b819-d8ad1df0778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:46.162792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4a384-85d4-4705-b819-d8ad1df0778b None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:46.163078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4a384-85d4-4705-b819-d8ad1df0778b None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:46.163930 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4a384-85d4-4705-b819-d8ad1df0778b None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:46.164668 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4a384-85d4-4705-b819-d8ad1df0778b None admin] RBAC: Adding query filter params (name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:46.164978 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4a384-85d4-4705-b819-d8ad1df0778b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:46.166377 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4a384-85d4-4705-b819-d8ad1df0778b None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:46.175615 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 299/587] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Jul 28 11:04:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:46.180801 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a76a9-c08c-433d-abc6-3fc33bca21ce None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:46.246179 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:46.290804 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a76a9-c08c-433d-abc6-3fc33bca21ce None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:46.330694 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d574ea-9f38-430b-a8dc-861ff8dccc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:46.331682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d574ea-9f38-430b-a8dc-861ff8dccc91 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:46.332179 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d574ea-9f38-430b-a8dc-861ff8dccc91 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:46.332635 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d574ea-9f38-430b-a8dc-861ff8dccc91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:46.344817 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d574ea-9f38-430b-a8dc-861ff8dccc91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:46.346709 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d574ea-9f38-430b-a8dc-861ff8dccc91 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:46.361735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-68d574ea-9f38-430b-a8dc-861ff8dccc91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:46.361735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:46.361735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:46.361735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:46.361735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:46.361735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:46.361735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:46.361735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:46.361735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:46.361735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:46.361735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:46.361735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:46.361735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:46.361735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:46.361735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:46.362617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:46.362617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:46.362617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:46.362617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:46.362617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:46.362617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:46.362617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:46.362617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:46.362617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:46.362617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:46.362617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:46.362617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:46.362617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:46.362617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:46.362617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:46.362617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:46.362617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:46.363523 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:46.363523 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:46.363523 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:46.363523 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:46.365518 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 289/588] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:46.375361 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4a384-85d4-4705-b819-d8ad1df0778b None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:46.499878 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4a384-85d4-4705-b819-d8ad1df0778b None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:46.537154 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101e5d0-935c-4016-ba4f-b77ac9370b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:46.537787 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101e5d0-935c-4016-ba4f-b77ac9370b39 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:46.538072 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101e5d0-935c-4016-ba4f-b77ac9370b39 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:46.538881 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101e5d0-935c-4016-ba4f-b77ac9370b39 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:46.539630 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101e5d0-935c-4016-ba4f-b77ac9370b39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:46.539939 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101e5d0-935c-4016-ba4f-b77ac9370b39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:46.541320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101e5d0-935c-4016-ba4f-b77ac9370b39 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:46.555120 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 300/589] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:46.560355 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d574ea-9f38-430b-a8dc-861ff8dccc91 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:46.617306 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e981e-c0ee-4e31-a940-3c4d45a86959 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:46.617629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e981e-c0ee-4e31-a940-3c4d45a86959 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:46.617914 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e981e-c0ee-4e31-a940-3c4d45a86959 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:46.619653 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 301/590] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:46.626685 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbfb58-e7a5-4272-8100-eaec2570c796 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:46.627199 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbfb58-e7a5-4272-8100-eaec2570c796 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:46.627747 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbfb58-e7a5-4272-8100-eaec2570c796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:46.646970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-d2bbfb58-e7a5-4272-8100-eaec2570c796 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:46.648291 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-d2bbfb58-e7a5-4272-8100-eaec2570c796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:46.668291 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:46.684809 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d574ea-9f38-430b-a8dc-861ff8dccc91 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:46.699939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:46.723738 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcdd99-60b4-4a62-beab-9604ebb80d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:46.724435 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcdd99-60b4-4a62-beab-9604ebb80d39 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:46.724729 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcdd99-60b4-4a62-beab-9604ebb80d39 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:46.725013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcdd99-60b4-4a62-beab-9604ebb80d39 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:46.734121 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcdd99-60b4-4a62-beab-9604ebb80d39 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:46.735385 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 302/591] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:04:46.735814 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcdd99-60b4-4a62-beab-9604ebb80d39 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:46.748282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-63fcdd99-60b4-4a62-beab-9604ebb80d39 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 11:04:46.748282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:46.748282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:46.748282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:46.748282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:46.748282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:46.748282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:46.748282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:46.748282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:46.748282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:46.748282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:46.748282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:46.748282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:04:46.748282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:04:46.748282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:04:46.748282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:04:46.756539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:46.756539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:46.756539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:04:46.756539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:46.756539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:04:46.756539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:46.756539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:46.756539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:46.756539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:46.756539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:46.756539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:46.756539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:46.756539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:46.756539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:46.756539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:46.756539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:46.756539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:46.756539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:46.763741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:46.763741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:46.763741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:04:46.763741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:04:46.763741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:04:46.763741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:04:46.763741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:04:46.763741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:04:46.763741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 11:04:46.763741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:46.763741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 290/592] 10.222.0.71 () {56 vars in 1093 bytes} [Thu Jul 28 11:04:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:46.764329 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbfb58-e7a5-4272-8100-eaec2570c796 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:46.764405 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcdd99-60b4-4a62-beab-9604ebb80d39 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:46.882339 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbfb58-e7a5-4272-8100-eaec2570c796 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:46.910014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcdd99-60b4-4a62-beab-9604ebb80d39 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:46.922448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6937027-6080-4019-bf9b-32bb0c3a708a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:46.923076 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6937027-6080-4019-bf9b-32bb0c3a708a None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:46.923378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6937027-6080-4019-bf9b-32bb0c3a708a None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:46.923656 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6937027-6080-4019-bf9b-32bb0c3a708a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:46.939869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6937027-6080-4019-bf9b-32bb0c3a708a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:46.944831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-d6937027-6080-4019-bf9b-32bb0c3a708a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:46.944831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:46.944831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:46.944831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:46.944831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:46.944831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:46.944831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:46.944831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:46.944831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:46.944831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:46.944831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:46.944831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:46.944831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:46.944831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:46.944831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:46.944831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:46.946551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:46.946551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:46.946551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:46.946551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:46.946551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:46.946551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:46.946551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:46.946551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:46.946551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:46.946551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:46.946551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:46.946551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:46.946551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:46.946551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:46.946551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:46.946551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:46.947797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:46.947797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:46.947797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:46.947797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:46.947797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:46.947797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:46.947797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:46.947797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:46.947797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:46.947797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:46.947797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:46.947797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:46.947797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 303/593] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Jul 28 11:04:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:04:46.954484 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6937027-6080-4019-bf9b-32bb0c3a708a None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:46.974728 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:46.977501 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39591a-234c-4dc0-82f5-3a69fee96fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:46.978431 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39591a-234c-4dc0-82f5-3a69fee96fa6 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:46.978919 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39591a-234c-4dc0-82f5-3a69fee96fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:46.979516 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39591a-234c-4dc0-82f5-3a69fee96fa6 None admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:46.980806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39591a-234c-4dc0-82f5-3a69fee96fa6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:46.981151 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39591a-234c-4dc0-82f5-3a69fee96fa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:46.983176 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39591a-234c-4dc0-82f5-3a69fee96fa6 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:47.010070 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 291/594] 10.222.0.71 () {56 vars in 1133 bytes} [Thu Jul 28 11:04:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:47.011748 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39591a-234c-4dc0-82f5-3a69fee96fa6 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:47.048473 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:47.083774 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6937027-6080-4019-bf9b-32bb0c3a708a None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:47.134917 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be5fd1-8af2-4d01-a0fe-2809b52000b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:47.135608 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be5fd1-8af2-4d01-a0fe-2809b52000b3 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:47.135903 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be5fd1-8af2-4d01-a0fe-2809b52000b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:47.136447 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be5fd1-8af2-4d01-a0fe-2809b52000b3 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:47.137145 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be5fd1-8af2-4d01-a0fe-2809b52000b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:47.137451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be5fd1-8af2-4d01-a0fe-2809b52000b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:47.139357 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be5fd1-8af2-4d01-a0fe-2809b52000b3 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:47.151436 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 304/595] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Jul 28 11:04:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:47.156578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be5fd1-8af2-4d01-a0fe-2809b52000b3 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:47.175120 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39591a-234c-4dc0-82f5-3a69fee96fa6 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:47.220238 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e0edc-f687-43ca-848b-b37868e1fa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:47.221376 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e0edc-f687-43ca-848b-b37868e1fa3a None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:47.221968 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e0edc-f687-43ca-848b-b37868e1fa3a None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:47.222477 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e0edc-f687-43ca-848b-b37868e1fa3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:47.262793 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:47.295589 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be5fd1-8af2-4d01-a0fe-2809b52000b3 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:47.313803 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e0edc-f687-43ca-848b-b37868e1fa3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:47.315335 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e0edc-f687-43ca-848b-b37868e1fa3a None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:47.338833 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04af47-45d8-470d-ae4d-a192cf1f463c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:47.339542 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04af47-45d8-470d-ae4d-a192cf1f463c None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:47.339839 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04af47-45d8-470d-ae4d-a192cf1f463c None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:47.340124 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04af47-45d8-470d-ae4d-a192cf1f463c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:47.350573 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:47.352581 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04af47-45d8-470d-ae4d-a192cf1f463c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:47.354223 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04af47-45d8-470d-ae4d-a192cf1f463c None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:47.373353 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-bb04af47-45d8-470d-ae4d-a192cf1f463c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:47.373353 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:47.373353 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:47.373353 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:47.373353 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:47.373353 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:47.373353 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:47.373353 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:47.373353 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:47.373353 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:47.373353 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:47.373353 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:47.373353 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:47.373353 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:47.373353 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:47.374289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:47.374289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:47.374289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:47.374289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:47.374289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:47.374289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:47.374289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:47.374289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:47.374289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:47.374289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:47.374289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:47.374289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:47.374289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:47.374289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:47.374289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:47.374289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:47.374289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:47.375164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:47.375164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:47.375164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:47.375164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:47.375164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 305/596] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:04:47.375164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652f77e-36b2-4179-a03a-16442c3a26f0 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:47.375164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652f77e-36b2-4179-a03a-16442c3a26f0 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:47.375164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652f77e-36b2-4179-a03a-16442c3a26f0 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:47.375650 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 306/597] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:47.376628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad739acf-4b04-4b8e-ba00-d24b525807d6 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:47.376909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad739acf-4b04-4b8e-ba00-d24b525807d6 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:47.377182 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad739acf-4b04-4b8e-ba00-d24b525807d6 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:47.378493 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 307/598] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:47.380649 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66685fa-78fe-481e-b103-f949c6382d90 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:47.381059 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66685fa-78fe-481e-b103-f949c6382d90 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:47.381343 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66685fa-78fe-481e-b103-f949c6382d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:47.400882 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-a66685fa-78fe-481e-b103-f949c6382d90 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:47.402144 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-a66685fa-78fe-481e-b103-f949c6382d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:47.445631 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 292/599] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:47.447310 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583fd7a-4f73-4699-ad67-c1facaa3c93b None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:47.447606 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583fd7a-4f73-4699-ad67-c1facaa3c93b None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:47.447883 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583fd7a-4f73-4699-ad67-c1facaa3c93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:47.471314 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-6583fd7a-4f73-4699-ad67-c1facaa3c93b None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:47.472525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-6583fd7a-4f73-4699-ad67-c1facaa3c93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:47.487764 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 308/600] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:04:47.492792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66685fa-78fe-481e-b103-f949c6382d90 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:47.541732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 293/601] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:47.542489 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583fd7a-4f73-4699-ad67-c1facaa3c93b None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:47.552950 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:47.600437 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66685fa-78fe-481e-b103-f949c6382d90 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:47.621469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:47.636723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b0ebe-18da-4247-a3d5-9da305be1f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:47.637347 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0ebe-18da-4247-a3d5-9da305be1f9f None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:47.637628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0ebe-18da-4247-a3d5-9da305be1f9f None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:47.637900 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0ebe-18da-4247-a3d5-9da305be1f9f None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:47.638675 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b0ebe-18da-4247-a3d5-9da305be1f9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:47.638898 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b0ebe-18da-4247-a3d5-9da305be1f9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:47.640308 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b0ebe-18da-4247-a3d5-9da305be1f9f None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:47.651853 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 309/602] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:47.652671 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b0ebe-18da-4247-a3d5-9da305be1f9f None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:47.664243 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583fd7a-4f73-4699-ad67-c1facaa3c93b None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:47.700171 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dc11c-1e9c-40bc-bd4d-038c4cb43e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:47.701507 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dc11c-1e9c-40bc-bd4d-038c4cb43e82 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:47.701793 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dc11c-1e9c-40bc-bd4d-038c4cb43e82 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:47.702061 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dc11c-1e9c-40bc-bd4d-038c4cb43e82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:47.712873 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1dc11c-1e9c-40bc-bd4d-038c4cb43e82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:47.714370 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1dc11c-1e9c-40bc-bd4d-038c4cb43e82 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:47.729198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-ff1dc11c-1e9c-40bc-bd4d-038c4cb43e82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:47.729198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:47.729198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:47.729198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:47.729198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:47.729198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:47.729198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:47.729198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:47.729198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:47.729198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:47.729198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:47.729198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:47.729198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:47.729198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:47.729198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:47.730599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:47.730599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:47.730599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:47.730599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:47.730599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:47.730599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:47.730599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:47.730599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:47.730599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:47.730599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:47.730599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:47.730599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:47.730599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:47.730599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:47.730599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:47.730599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:47.730599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:47.731649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:47.731649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:47.731649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:47.731649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:47.731649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 294/603] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:47.731649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dc11c-1e9c-40bc-bd4d-038c4cb43e82 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:47.757041 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b0ebe-18da-4247-a3d5-9da305be1f9f None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:47.773999 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:47.793078 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbf4d6-9a49-44e6-a447-7b41c58daf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:47.793642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbf4d6-9a49-44e6-a447-7b41c58daf4c None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:47.793933 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbf4d6-9a49-44e6-a447-7b41c58daf4c None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:47.794205 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbf4d6-9a49-44e6-a447-7b41c58daf4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:47.805160 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bbf4d6-9a49-44e6-a447-7b41c58daf4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:47.810557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-81bbf4d6-9a49-44e6-a447-7b41c58daf4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:47.810557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:47.810557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:47.810557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:47.810557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:47.810557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:47.810557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:47.810557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:47.810557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:47.810557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:47.810557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:47.810557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:47.810557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:47.810557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:47.810557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:47.810557 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:47.811535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:47.811535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:47.811535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:47.811535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:47.811535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:47.811535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:47.811535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:47.811535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:47.811535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:47.811535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:47.811535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:47.811535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:47.811535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:47.811535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:47.811535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:47.811535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:47.812354 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:47.812354 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:47.812354 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:47.812354 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:47.812354 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:47.812354 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:47.812354 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:47.812354 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:47.812354 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:47.812354 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:47.812354 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:47.812354 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:47.812354 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 310/604] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Jul 28 11:04:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:47.813074 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbf4d6-9a49-44e6-a447-7b41c58daf4c None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:47.844854 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dc11c-1e9c-40bc-bd4d-038c4cb43e82 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:47.860357 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:47.884878 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5774b-6031-4557-b6b0-a8cfd4e44386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:47.885498 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5774b-6031-4557-b6b0-a8cfd4e44386 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:47.885684 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5774b-6031-4557-b6b0-a8cfd4e44386 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:47.886471 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5774b-6031-4557-b6b0-a8cfd4e44386 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:47.898129 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5774b-6031-4557-b6b0-a8cfd4e44386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:47.903533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-74f5774b-6031-4557-b6b0-a8cfd4e44386 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:47.903533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:47.903533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:47.903533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:47.903533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:47.903533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:47.903533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:47.903533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:47.903533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:47.903533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:47.903533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:47.903533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:47.903533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:47.903533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:47.903533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:47.903533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:47.904654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:47.904654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:47.904654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:47.904654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:47.904654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:47.904654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:47.904654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:47.904654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:47.904654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:47.904654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:47.904654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:47.904654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:47.904654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:47.904654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:47.904654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:47.904654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:47.905674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:47.905674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:47.905674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:47.905674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:47.905674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:47.905674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:47.905674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:47.905674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:47.905674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:47.905674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:47.905674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:04:47.905674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:47.905674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 295/605] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Jul 28 11:04:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:47.905674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5774b-6031-4557-b6b0-a8cfd4e44386 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:47.922916 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbf4d6-9a49-44e6-a447-7b41c58daf4c None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:47.957317 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a96525-7f3b-4f89-862e-672f6f1c4fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:47.957972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a96525-7f3b-4f89-862e-672f6f1c4fb1 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:47.958252 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a96525-7f3b-4f89-862e-672f6f1c4fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:47.958534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a96525-7f3b-4f89-862e-672f6f1c4fb1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:47.966398 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a96525-7f3b-4f89-862e-672f6f1c4fb1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:47.967882 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a96525-7f3b-4f89-862e-672f6f1c4fb1 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:47.979373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-98a96525-7f3b-4f89-862e-672f6f1c4fb1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 11:04:47.979373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:47.979373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:47.979373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:47.979373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:47.979373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:47.979373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:47.979373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:47.979373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:47.979373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:47.979373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:47.979373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:47.979373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:04:47.979373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:04:47.979373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:04:47.979373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:04:47.980543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:47.980543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:47.980543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:04:47.980543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:47.980543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:04:47.980543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:47.980543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:47.980543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:47.980543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:47.980543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:47.980543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:47.980543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:47.980543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:47.980543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:47.980543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:47.980543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:47.980543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:47.980543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:47.986145 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:47.986145 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:47.986145 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:04:47.986145 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:04:47.986145 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:04:47.986145 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:04:47.986145 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:04:47.986145 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:04:47.986145 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 11:04:47.986145 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:47.986145 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 311/606] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:47.986145 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a96525-7f3b-4f89-862e-672f6f1c4fb1 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:48.013215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5774b-6031-4557-b6b0-a8cfd4e44386 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:48.018540 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:48.048620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b057897-5638-42a5-a4a1-c926f4f09429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:48.049131 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b057897-5638-42a5-a4a1-c926f4f09429 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:48.049419 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b057897-5638-42a5-a4a1-c926f4f09429 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:48.049700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b057897-5638-42a5-a4a1-c926f4f09429 None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:48.050477 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b057897-5638-42a5-a4a1-c926f4f09429 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:48.050787 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b057897-5638-42a5-a4a1-c926f4f09429 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:48.052195 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b057897-5638-42a5-a4a1-c926f4f09429 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:48.064113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 296/607] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:48.064945 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b057897-5638-42a5-a4a1-c926f4f09429 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:48.093082 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a96525-7f3b-4f89-862e-672f6f1c4fb1 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:48.098568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:48.128459 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f59eb-6cef-4662-9ea6-f38276ce42b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:48.129076 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f59eb-6cef-4662-9ea6-f38276ce42b3 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:48.129359 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f59eb-6cef-4662-9ea6-f38276ce42b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:48.129638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f59eb-6cef-4662-9ea6-f38276ce42b3 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:48.130350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f59eb-6cef-4662-9ea6-f38276ce42b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:48.130653 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f59eb-6cef-4662-9ea6-f38276ce42b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:48.132048 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f59eb-6cef-4662-9ea6-f38276ce42b3 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:48.141134 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 312/608] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Jul 28 11:04:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:48.141932 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f59eb-6cef-4662-9ea6-f38276ce42b3 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:48.170589 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b057897-5638-42a5-a4a1-c926f4f09429 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:48.205308 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726264d-0718-4777-9993-886289a9fea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:48.205941 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726264d-0718-4777-9993-886289a9fea4 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:48.206225 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726264d-0718-4777-9993-886289a9fea4 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:48.206527 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726264d-0718-4777-9993-886289a9fea4 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:48.207216 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726264d-0718-4777-9993-886289a9fea4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:48.207551 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726264d-0718-4777-9993-886289a9fea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:48.208934 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726264d-0718-4777-9993-886289a9fea4 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:48.218103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 297/609] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Jul 28 11:04:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:48.218907 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726264d-0718-4777-9993-886289a9fea4 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:48.242149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:48.245803 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f59eb-6cef-4662-9ea6-f38276ce42b3 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:48.283719 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76408a-4bdd-48aa-8ede-33ba121e717c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:48.284352 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76408a-4bdd-48aa-8ede-33ba121e717c None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:48.284630 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76408a-4bdd-48aa-8ede-33ba121e717c None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:48.284908 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76408a-4bdd-48aa-8ede-33ba121e717c None admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:48.285702 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76408a-4bdd-48aa-8ede-33ba121e717c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:48.286114 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76408a-4bdd-48aa-8ede-33ba121e717c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:48.287635 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76408a-4bdd-48aa-8ede-33ba121e717c None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:48.307042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 313/610] 10.222.0.71 () {56 vars in 1137 bytes} [Thu Jul 28 11:04:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:48.308350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76408a-4bdd-48aa-8ede-33ba121e717c None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:48.313715 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:48.321404 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726264d-0718-4777-9993-886289a9fea4 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:48.355232 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5632dd-21b2-4a14-8d2a-2142356fa1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:48.355920 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5632dd-21b2-4a14-8d2a-2142356fa1c9 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:48.356205 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5632dd-21b2-4a14-8d2a-2142356fa1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:48.356484 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5632dd-21b2-4a14-8d2a-2142356fa1c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:48.363292 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5632dd-21b2-4a14-8d2a-2142356fa1c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:48.364771 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5632dd-21b2-4a14-8d2a-2142356fa1c9 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:48.377542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-4c5632dd-21b2-4a14-8d2a-2142356fa1c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:48.377542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:48.377542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:48.377542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:48.377542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:48.377542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:48.377542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:48.377542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:48.377542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:48.377542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:48.377542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:48.377542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:48.377542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:04:48.377542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:04:48.377542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:04:48.378411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:04:48.378411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:48.378411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:48.378411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:48.378411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:48.378411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:48.378411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:48.378411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:48.378411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:48.378411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:48.378411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:48.378411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:48.378411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:48.378411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:48.378411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:48.378411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:48.378411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:48.379695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:04:48.379695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:04:48.379695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:04:48.379695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:04:48.379695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:04:48.379695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:04:48.379695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:48.379695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:48.379695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 298/611] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:48.379695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5632dd-21b2-4a14-8d2a-2142356fa1c9 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:48.417652 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76408a-4bdd-48aa-8ede-33ba121e717c None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:48.456387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3f940-3bee-4a60-96f0-57c6ee85785f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:48.457037 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3f940-3bee-4a60-96f0-57c6ee85785f None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:48.457329 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3f940-3bee-4a60-96f0-57c6ee85785f None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:48.457607 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3f940-3bee-4a60-96f0-57c6ee85785f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:48.469676 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3f940-3bee-4a60-96f0-57c6ee85785f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:48.471159 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3f940-3bee-4a60-96f0-57c6ee85785f None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:48.486986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-41e3f940-3bee-4a60-96f0-57c6ee85785f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:48.486986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:48.486986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:48.486986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:48.486986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:48.486986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:48.486986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:48.486986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:48.486986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:48.486986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:48.486986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:48.486986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:48.486986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:48.486986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:48.486986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:48.488125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:48.488125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:48.488125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:48.488125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:48.488125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:48.488125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:48.488125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:48.488125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:48.488125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:48.488125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:48.488125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:48.488125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:48.488125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:48.488125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:48.488125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:48.488125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:48.488125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:48.489229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:48.489229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:48.489229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:48.489229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:48.489229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 314/612] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:48.489229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3f940-3bee-4a60-96f0-57c6ee85785f None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:48.495284 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5632dd-21b2-4a14-8d2a-2142356fa1c9 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:48.500015 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:48.530261 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c6cec-138e-4214-9643-162d40ea0947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:48.530902 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c6cec-138e-4214-9643-162d40ea0947 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:48.531210 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c6cec-138e-4214-9643-162d40ea0947 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:48.531519 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c6cec-138e-4214-9643-162d40ea0947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:48.543014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c6cec-138e-4214-9643-162d40ea0947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:48.544521 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c6cec-138e-4214-9643-162d40ea0947 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:48.558361 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-d28c6cec-138e-4214-9643-162d40ea0947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:48.558361 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:48.558361 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:48.558361 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:48.558361 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:48.558361 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:48.558361 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:48.558361 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:48.558361 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:48.558361 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:48.558361 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:48.558361 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:48.558361 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:48.558361 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:48.558361 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:48.559436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:48.559436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:48.559436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:48.559436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:48.559436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:48.559436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:48.559436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:48.559436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:48.559436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:48.559436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:48.559436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:48.559436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:48.559436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:48.559436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:48.559436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:48.559436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:48.559436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:48.560342 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:48.560342 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:48.560342 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:48.560342 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:48.560342 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 299/613] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:48.560612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c6cec-138e-4214-9643-162d40ea0947 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:48.569833 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:48.594683 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3f940-3bee-4a60-96f0-57c6ee85785f None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:48.628644 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6332719-fc0c-4095-b8a6-88736b628484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:48.629263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6332719-fc0c-4095-b8a6-88736b628484 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:48.629551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6332719-fc0c-4095-b8a6-88736b628484 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:48.629829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6332719-fc0c-4095-b8a6-88736b628484 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:48.664378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c6cec-138e-4214-9643-162d40ea0947 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:48.700137 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6332719-fc0c-4095-b8a6-88736b628484 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:48.700770 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa190a-5071-4738-9f9f-1a82e4b042e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:48.701402 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa190a-5071-4738-9f9f-1a82e4b042e9 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:48.701625 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6332719-fc0c-4095-b8a6-88736b628484 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:48.701726 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa190a-5071-4738-9f9f-1a82e4b042e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:48.701954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa190a-5071-4738-9f9f-1a82e4b042e9 None admin] PATH_INFO: `/v3/projects` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:48.702705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa190a-5071-4738-9f9f-1a82e4b042e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:48.703011 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa190a-5071-4738-9f9f-1a82e4b042e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:48.704473 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa190a-5071-4738-9f9f-1a82e4b042e9 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:48.711434 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:48.722602 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 300/614] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:04:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:48.722602 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa190a-5071-4738-9f9f-1a82e4b042e9 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:48.789928 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:48.805145 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 315/615] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:48.805994 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6332719-fc0c-4095-b8a6-88736b628484 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:48.828453 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa190a-5071-4738-9f9f-1a82e4b042e9 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:48.872789 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cddf06-8158-42c3-aa78-c69cc9671e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:48.873427 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cddf06-8158-42c3-aa78-c69cc9671e6a None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:48.873718 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cddf06-8158-42c3-aa78-c69cc9671e6a None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:48.873997 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cddf06-8158-42c3-aa78-c69cc9671e6a None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:48.874695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cddf06-8158-42c3-aa78-c69cc9671e6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:48.875004 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cddf06-8158-42c3-aa78-c69cc9671e6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:48.876431 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cddf06-8158-42c3-aa78-c69cc9671e6a None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:48.888496 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 301/616] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:48.889394 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cddf06-8158-42c3-aa78-c69cc9671e6a None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:48.912593 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6332719-fc0c-4095-b8a6-88736b628484 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:48.922898 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:48.949436 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c2ae5-542d-4e56-be79-e2e7837cd0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:48.950061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c2ae5-542d-4e56-be79-e2e7837cd0db None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:48.950342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c2ae5-542d-4e56-be79-e2e7837cd0db None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:48.950623 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c2ae5-542d-4e56-be79-e2e7837cd0db None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:48.951352 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c2ae5-542d-4e56-be79-e2e7837cd0db None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:48.951660 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c2ae5-542d-4e56-be79-e2e7837cd0db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:48.953048 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c2ae5-542d-4e56-be79-e2e7837cd0db None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:48.964820 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 316/617] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:48.965652 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c2ae5-542d-4e56-be79-e2e7837cd0db None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:48.992120 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cddf06-8158-42c3-aa78-c69cc9671e6a None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:49.017000 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:49.025883 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8551ce4-2bc7-4c7c-9af6-2ffdb7364566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:49.026511 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8551ce4-2bc7-4c7c-9af6-2ffdb7364566 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:49.026792 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8551ce4-2bc7-4c7c-9af6-2ffdb7364566 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:49.027074 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8551ce4-2bc7-4c7c-9af6-2ffdb7364566 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:49.027892 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8551ce4-2bc7-4c7c-9af6-2ffdb7364566 None admin] RBAC: Adding query filter params (role.id=2889c6a70cf04dfda4618a8374822c11, scope.project.id=11f4749185bf4adba9ae3cf927b6880b, user.id=2bf7f66ba696444f8055a498e292a182) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:49.028202 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8551ce4-2bc7-4c7c-9af6-2ffdb7364566 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:49.029689 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8551ce4-2bc7-4c7c-9af6-2ffdb7364566 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:49.035850 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 302/618] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:04:48 2022] GET /identity/v3/role_assignments?user.id=2bf7f66ba696444f8055a498e292a182&scope.project.id=11f4749185bf4adba9ae3cf927b6880b&role.id=2889c6a70cf04dfda4618a8374822c11 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:49.036669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8551ce4-2bc7-4c7c-9af6-2ffdb7364566 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:49.083178 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c2ae5-542d-4e56-be79-e2e7837cd0db None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:49.123237 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65409d9b-20a7-484b-85d7-d9bff0d270d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:49.123926 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65409d9b-20a7-484b-85d7-d9bff0d270d6 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:49.124206 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65409d9b-20a7-484b-85d7-d9bff0d270d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:49.124481 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65409d9b-20a7-484b-85d7-d9bff0d270d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:49.138087 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65409d9b-20a7-484b-85d7-d9bff0d270d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:49.139651 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65409d9b-20a7-484b-85d7-d9bff0d270d6 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:49.155189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8551ce4-2bc7-4c7c-9af6-2ffdb7364566 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:49.159622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-65409d9b-20a7-484b-85d7-d9bff0d270d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:49.159622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:49.159622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:49.159622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:49.159622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:49.159622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:49.159622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:49.159622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:49.159622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:49.159622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:49.159622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:49.159622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:49.159622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:49.159622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:49.159622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:49.160554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:49.160554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:49.160554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:49.160554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:49.160554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:49.160554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:49.160554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:49.160554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:49.160554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:49.160554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:49.160554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:49.160554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:49.160554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:49.160554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:49.160554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:49.160554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:49.160554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:49.167094 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:49.167094 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:49.167094 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:49.167094 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:49.167094 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 317/619] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:49.167094 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65409d9b-20a7-484b-85d7-d9bff0d270d6 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:49.192390 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:49.200487 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738edcd8-a851-4305-82d1-d17be024d13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:49.201429 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738edcd8-a851-4305-82d1-d17be024d13e None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:49.201818 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738edcd8-a851-4305-82d1-d17be024d13e None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:49.202202 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738edcd8-a851-4305-82d1-d17be024d13e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:49.211473 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738edcd8-a851-4305-82d1-d17be024d13e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:49.213118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738edcd8-a851-4305-82d1-d17be024d13e None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:49.225701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-738edcd8-a851-4305-82d1-d17be024d13e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 11:04:49.225701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:49.225701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:49.225701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:49.225701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:49.225701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:49.225701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:49.225701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:49.225701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:49.225701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:49.225701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:49.225701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:49.225701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:04:49.225701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:04:49.225701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:04:49.225701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:04:49.227500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:49.227500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:49.227500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:04:49.227500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:49.227500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:04:49.227500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:49.227500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:49.227500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:49.227500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:49.227500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:49.227500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:49.227500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:49.227500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:49.227500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:49.227500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:49.227500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:49.227500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:49.227500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:49.228711 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:49.228711 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:49.228711 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:04:49.228711 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:04:49.228711 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:04:49.228711 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:04:49.228711 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:04:49.228711 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:04:49.228711 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 11:04:49.228711 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:49.229721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 303/620] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:49.230042 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738edcd8-a851-4305-82d1-d17be024d13e None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:49.286525 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65409d9b-20a7-484b-85d7-d9bff0d270d6 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:49.287913 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:49.327960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42b1ad-5aed-4698-a13e-2ca0b3f0e930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:49.328713 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42b1ad-5aed-4698-a13e-2ca0b3f0e930 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:49.329074 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42b1ad-5aed-4698-a13e-2ca0b3f0e930 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:49.329426 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42b1ad-5aed-4698-a13e-2ca0b3f0e930 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:49.338281 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42b1ad-5aed-4698-a13e-2ca0b3f0e930 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:49.339958 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42b1ad-5aed-4698-a13e-2ca0b3f0e930 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:49.347284 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738edcd8-a851-4305-82d1-d17be024d13e None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:49.352638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-3a42b1ad-5aed-4698-a13e-2ca0b3f0e930 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 11:04:49.352638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:49.352638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:49.352638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:49.352638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:49.352638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:49.352638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:49.352638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:49.352638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:49.352638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:49.352638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:49.352638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:49.352638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:04:49.352638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:04:49.352638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:04:49.352638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:04:49.353968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:49.353968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:49.353968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:04:49.353968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:49.353968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:04:49.353968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:49.353968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:49.353968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:49.353968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:49.353968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:49.353968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:49.353968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:49.353968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:49.353968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:49.353968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:49.353968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:49.353968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:49.353968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:49.355154 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:49.355154 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:49.355154 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:04:49.355154 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:04:49.355154 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:04:49.355154 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:04:49.355154 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:04:49.355154 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:04:49.355154 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 11:04:49.355154 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:49.355888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 318/621] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Jul 28 11:04:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:49.356735 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42b1ad-5aed-4698-a13e-2ca0b3f0e930 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:49.394801 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12730b-4145-4cfe-a5ad-360c24bea9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:49.395625 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12730b-4145-4cfe-a5ad-360c24bea9d2 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:49.395982 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12730b-4145-4cfe-a5ad-360c24bea9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:49.396331 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12730b-4145-4cfe-a5ad-360c24bea9d2 None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:49.397102 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12730b-4145-4cfe-a5ad-360c24bea9d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:49.397480 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12730b-4145-4cfe-a5ad-360c24bea9d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:49.399332 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12730b-4145-4cfe-a5ad-360c24bea9d2 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:49.417647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 304/622] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:49.417647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12730b-4145-4cfe-a5ad-360c24bea9d2 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:49.462438 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:49.493443 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42b1ad-5aed-4698-a13e-2ca0b3f0e930 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:49.533969 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f748b-e638-4fd4-a179-611ff89e3769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:49.534955 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f748b-e638-4fd4-a179-611ff89e3769 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:49.535341 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f748b-e638-4fd4-a179-611ff89e3769 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:49.535699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f748b-e638-4fd4-a179-611ff89e3769 None admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:49.536576 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f748b-e638-4fd4-a179-611ff89e3769 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:49.536964 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f748b-e638-4fd4-a179-611ff89e3769 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:49.539027 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f748b-e638-4fd4-a179-611ff89e3769 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:49.544409 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12730b-4145-4cfe-a5ad-360c24bea9d2 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:49.562992 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 319/623] 10.222.0.71 () {56 vars in 1137 bytes} [Thu Jul 28 11:04:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:49.562992 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f748b-e638-4fd4-a179-611ff89e3769 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:49.570673 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:49.608176 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b130bd-f58c-452f-8ca0-08d6d1bfad23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:49.609049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b130bd-f58c-452f-8ca0-08d6d1bfad23 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:49.609337 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b130bd-f58c-452f-8ca0-08d6d1bfad23 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:49.609614 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b130bd-f58c-452f-8ca0-08d6d1bfad23 None admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:49.610421 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b130bd-f58c-452f-8ca0-08d6d1bfad23 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:49.610729 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b130bd-f58c-452f-8ca0-08d6d1bfad23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:49.612209 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b130bd-f58c-452f-8ca0-08d6d1bfad23 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:49.637071 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 305/624] 10.222.0.71 () {56 vars in 1139 bytes} [Thu Jul 28 11:04:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:49.637071 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b130bd-f58c-452f-8ca0-08d6d1bfad23 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:49.686244 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f748b-e638-4fd4-a179-611ff89e3769 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:49.726641 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ca5b4-1257-45bf-9987-1062e478e179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:49.727349 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ca5b4-1257-45bf-9987-1062e478e179 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:49.727634 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ca5b4-1257-45bf-9987-1062e478e179 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:49.727915 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ca5b4-1257-45bf-9987-1062e478e179 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:49.737046 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ca5b4-1257-45bf-9987-1062e478e179 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:49.738556 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ca5b4-1257-45bf-9987-1062e478e179 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:49.740787 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:49.753923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-1e0ca5b4-1257-45bf-9987-1062e478e179 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:49.753923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:49.753923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:49.753923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:49.753923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:49.753923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:49.753923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:49.753923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:49.753923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:49.753923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:49.753923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:49.753923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:49.753923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:04:49.753923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:04:49.753923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:04:49.755105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:04:49.755105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:49.755105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:49.755105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:49.755105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:49.755105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:49.755105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:49.755105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:49.755105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:49.755105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:49.755105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:49.755105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:49.755105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:49.755105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:49.755105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:49.755105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:49.755105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:49.756228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:04:49.756228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:04:49.756228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:04:49.756228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:04:49.756228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:04:49.756228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:04:49.756228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:49.756228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:49.756228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 320/625] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:49.756996 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ca5b4-1257-45bf-9987-1062e478e179 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:49.768930 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b130bd-f58c-452f-8ca0-08d6d1bfad23 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:49.816279 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716e016-3594-4b46-b3c2-711820e2e75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:49.816913 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716e016-3594-4b46-b3c2-711820e2e75d None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:49.817201 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716e016-3594-4b46-b3c2-711820e2e75d None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:49.817482 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716e016-3594-4b46-b3c2-711820e2e75d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:49.857657 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:49.877977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ca5b4-1257-45bf-9987-1062e478e179 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:49.897255 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716e016-3594-4b46-b3c2-711820e2e75d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:49.898860 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716e016-3594-4b46-b3c2-711820e2e75d None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:49.917715 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f4e00-a31c-4fb7-9e27-77f4707d7c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:49.918363 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f4e00-a31c-4fb7-9e27-77f4707d7c86 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:49.918640 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f4e00-a31c-4fb7-9e27-77f4707d7c86 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:49.918916 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f4e00-a31c-4fb7-9e27-77f4707d7c86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:49.998531 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:50.003961 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f4e00-a31c-4fb7-9e27-77f4707d7c86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:50.005886 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f4e00-a31c-4fb7-9e27-77f4707d7c86 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:50.026290 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 306/626] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:50.027560 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716e016-3594-4b46-b3c2-711820e2e75d None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:50.098182 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:50.136750 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 321/627] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:50.137929 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f4e00-a31c-4fb7-9e27-77f4707d7c86 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:50.138626 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716e016-3594-4b46-b3c2-711820e2e75d None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:50.187868 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80345bae-a41b-409c-8afa-16d2a5e6d960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:50.188518 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80345bae-a41b-409c-8afa-16d2a5e6d960 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:50.188800 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80345bae-a41b-409c-8afa-16d2a5e6d960 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:50.189076 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80345bae-a41b-409c-8afa-16d2a5e6d960 None admin] PATH_INFO: `/v3/projects` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:50.189896 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80345bae-a41b-409c-8afa-16d2a5e6d960 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:50.190305 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80345bae-a41b-409c-8afa-16d2a5e6d960 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:50.191747 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80345bae-a41b-409c-8afa-16d2a5e6d960 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:50.212887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 307/628] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:04:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:50.212887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80345bae-a41b-409c-8afa-16d2a5e6d960 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:50.263702 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:50.268744 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f4e00-a31c-4fb7-9e27-77f4707d7c86 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:50.318653 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85061241-d273-47af-923c-73d1721f0a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:50.319361 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85061241-d273-47af-923c-73d1721f0a45 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:50.320206 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85061241-d273-47af-923c-73d1721f0a45 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:50.320483 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85061241-d273-47af-923c-73d1721f0a45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:50.332898 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85061241-d273-47af-923c-73d1721f0a45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:50.334521 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85061241-d273-47af-923c-73d1721f0a45 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:50.350277 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80345bae-a41b-409c-8afa-16d2a5e6d960 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:50.354461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-85061241-d273-47af-923c-73d1721f0a45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:50.354461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:50.354461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:50.354461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:50.354461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:50.354461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:50.354461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:50.354461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:50.354461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:50.354461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:50.354461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:50.354461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:50.354461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:50.354461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:50.354461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:50.355637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:50.355637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:50.355637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:50.355637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:50.355637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:50.355637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:50.355637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:50.355637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:50.355637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:50.355637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:50.355637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:50.355637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:50.355637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:50.355637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:50.355637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:50.355637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:50.355637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:50.356499 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:50.356499 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:50.356499 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:50.356499 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:50.356499 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 322/629] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:50.356854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85061241-d273-47af-923c-73d1721f0a45 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:50.387782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:50.396499 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743b566-50bc-465c-a1f8-03e80dc82e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:50.397152 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743b566-50bc-465c-a1f8-03e80dc82e07 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:50.398944 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743b566-50bc-465c-a1f8-03e80dc82e07 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:50.398944 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743b566-50bc-465c-a1f8-03e80dc82e07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:50.410770 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743b566-50bc-465c-a1f8-03e80dc82e07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:50.412287 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743b566-50bc-465c-a1f8-03e80dc82e07 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:50.428669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-e743b566-50bc-465c-a1f8-03e80dc82e07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:50.428669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:50.428669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:50.428669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:50.428669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:50.428669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:50.428669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:50.428669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:50.428669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:50.428669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:50.428669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:50.428669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:50.428669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:50.428669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:50.428669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:50.429651 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:50.429651 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:50.429651 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:50.429651 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:50.429651 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:50.429651 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:50.429651 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:50.429651 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:50.429651 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:50.429651 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:50.429651 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:50.429651 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:50.429651 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:50.429651 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:50.429651 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:50.429651 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:50.429651 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:50.430536 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:50.430536 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:50.430536 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:50.430536 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:50.430536 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 308/630] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:50.430800 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743b566-50bc-465c-a1f8-03e80dc82e07 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:50.486837 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85061241-d273-47af-923c-73d1721f0a45 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:50.526485 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1dc89c-bf64-4b0a-9e37-a49ec6d6c3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:50.527254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dc89c-bf64-4b0a-9e37-a49ec6d6c3fc None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:50.527546 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dc89c-bf64-4b0a-9e37-a49ec6d6c3fc None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:50.527823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dc89c-bf64-4b0a-9e37-a49ec6d6c3fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:50.528614 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1dc89c-bf64-4b0a-9e37-a49ec6d6c3fc None admin] RBAC: Adding query filter params (role.id=2889c6a70cf04dfda4618a8374822c11, scope.project.id=11f4749185bf4adba9ae3cf927b6880b, user.id=51f33b105ddb4c81a9ead57fd2d888ac) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:50.528928 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1dc89c-bf64-4b0a-9e37-a49ec6d6c3fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:50.530621 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1dc89c-bf64-4b0a-9e37-a49ec6d6c3fc None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:50.544873 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 323/631] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:04:50 2022] GET /identity/v3/role_assignments?user.id=51f33b105ddb4c81a9ead57fd2d888ac&scope.project.id=11f4749185bf4adba9ae3cf927b6880b&role.id=2889c6a70cf04dfda4618a8374822c11 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:50.544873 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1dc89c-bf64-4b0a-9e37-a49ec6d6c3fc None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:50.550569 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743b566-50bc-465c-a1f8-03e80dc82e07 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:50.565492 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:50.596659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed30c1-95fb-448d-ad91-5dd01e56e171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:50.598048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed30c1-95fb-448d-ad91-5dd01e56e171 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:50.598048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed30c1-95fb-448d-ad91-5dd01e56e171 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:50.598369 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed30c1-95fb-448d-ad91-5dd01e56e171 None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:50.599202 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed30c1-95fb-448d-ad91-5dd01e56e171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:50.599665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed30c1-95fb-448d-ad91-5dd01e56e171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:50.601754 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed30c1-95fb-448d-ad91-5dd01e56e171 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:50.621353 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 309/632] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:50.622946 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed30c1-95fb-448d-ad91-5dd01e56e171 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:50.673289 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:50.676147 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1dc89c-bf64-4b0a-9e37-a49ec6d6c3fc None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:50.720587 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e37f26-ca30-45d4-a05c-74058146bfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:50.721623 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e37f26-ca30-45d4-a05c-74058146bfbd None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:50.722181 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e37f26-ca30-45d4-a05c-74058146bfbd None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:50.722695 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e37f26-ca30-45d4-a05c-74058146bfbd None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:50.723667 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e37f26-ca30-45d4-a05c-74058146bfbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:50.724173 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e37f26-ca30-45d4-a05c-74058146bfbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:50.726056 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e37f26-ca30-45d4-a05c-74058146bfbd None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:50.740574 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 324/633] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:50.746955 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e37f26-ca30-45d4-a05c-74058146bfbd None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:50.747836 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed30c1-95fb-448d-ad91-5dd01e56e171 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:50.794936 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c483f85-893f-4110-80b8-43d90bd13ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:50.795830 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c483f85-893f-4110-80b8-43d90bd13ac8 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:50.795954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c483f85-893f-4110-80b8-43d90bd13ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:50.796176 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c483f85-893f-4110-80b8-43d90bd13ac8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:50.806944 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c483f85-893f-4110-80b8-43d90bd13ac8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:50.809168 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c483f85-893f-4110-80b8-43d90bd13ac8 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:50.823541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-2c483f85-893f-4110-80b8-43d90bd13ac8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:50.823541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:50.823541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:50.823541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:50.823541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:50.823541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:50.823541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:50.823541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:50.823541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:50.823541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:50.823541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:50.823541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:50.823541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:04:50.823541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:04:50.823541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:04:50.824502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:04:50.824502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:50.824502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:50.824502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:50.824502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:50.824502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:50.824502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:50.824502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:50.824502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:50.824502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:50.824502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:50.824502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:50.824502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:50.824502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:50.824502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:50.824502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:50.824502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:50.825404 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:04:50.825404 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:04:50.825404 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:04:50.825404 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:04:50.825404 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:04:50.825404 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:04:50.825404 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:50.825404 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:50.825404 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 310/634] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:04:50.831229 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c483f85-893f-4110-80b8-43d90bd13ac8 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:50.865853 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:50.905130 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e37f26-ca30-45d4-a05c-74058146bfbd None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:50.946148 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:50.951660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c483f85-893f-4110-80b8-43d90bd13ac8 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:50.953120 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73827d7-1aff-4a9c-a21d-7232ea0df2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:50.953882 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73827d7-1aff-4a9c-a21d-7232ea0df2d0 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:50.954269 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73827d7-1aff-4a9c-a21d-7232ea0df2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:50.954651 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73827d7-1aff-4a9c-a21d-7232ea0df2d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:50.962706 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73827d7-1aff-4a9c-a21d-7232ea0df2d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:50.964336 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73827d7-1aff-4a9c-a21d-7232ea0df2d0 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:50.976420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-b73827d7-1aff-4a9c-a21d-7232ea0df2d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:50.976420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:50.976420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:50.976420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:50.976420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:50.976420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:50.976420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:50.976420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:50.976420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:50.976420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:50.976420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:50.976420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:50.976420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:04:50.976420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:04:50.976420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:04:50.977563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:04:50.977563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:50.977563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:50.977563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:50.977563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:50.977563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:50.977563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:50.977563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:50.977563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:50.977563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:50.977563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:50.977563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:50.977563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:50.977563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:50.977563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:50.977563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:50.977563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:50.978642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:04:50.978642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:04:50.978642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:04:50.978642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:04:50.978642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:04:50.978642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:04:50.978642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:50.978642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:50.985072 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 325/635] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:50.986488 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73827d7-1aff-4a9c-a21d-7232ea0df2d0 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:50.999417 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb12e9c-8fd4-46b0-b360-94f282183576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:51.000296 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb12e9c-8fd4-46b0-b360-94f282183576 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:51.001157 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb12e9c-8fd4-46b0-b360-94f282183576 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:51.001597 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb12e9c-8fd4-46b0-b360-94f282183576 None admin] PATH_INFO: `/v3/projects` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:51.002824 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb12e9c-8fd4-46b0-b360-94f282183576 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:51.003311 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb12e9c-8fd4-46b0-b360-94f282183576 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:51.005715 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb12e9c-8fd4-46b0-b360-94f282183576 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:51.024928 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 311/636] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:04:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:51.032283 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb12e9c-8fd4-46b0-b360-94f282183576 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:51.126857 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73827d7-1aff-4a9c-a21d-7232ea0df2d0 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:51.149959 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb12e9c-8fd4-46b0-b360-94f282183576 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:51.169271 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18005652-2f27-4efa-9cb7-edc46db3a9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:51.170716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18005652-2f27-4efa-9cb7-edc46db3a9bd None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:51.171472 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18005652-2f27-4efa-9cb7-edc46db3a9bd None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:51.171977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18005652-2f27-4efa-9cb7-edc46db3a9bd None admin] PATH_INFO: `/v3/projects` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:51.173185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18005652-2f27-4efa-9cb7-edc46db3a9bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:51.174002 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18005652-2f27-4efa-9cb7-edc46db3a9bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:51.175674 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18005652-2f27-4efa-9cb7-edc46db3a9bd None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:51.178372 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:51.193854 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492e02a-390e-411e-8b62-305e8ba7f485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:51.195303 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492e02a-390e-411e-8b62-305e8ba7f485 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:51.195482 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492e02a-390e-411e-8b62-305e8ba7f485 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:51.195868 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492e02a-390e-411e-8b62-305e8ba7f485 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:51.196056 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 326/637] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:04:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:51.196854 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492e02a-390e-411e-8b62-305e8ba7f485 None admin] RBAC: Adding query filter params (role.id=2889c6a70cf04dfda4618a8374822c11, scope.project.id=11f4749185bf4adba9ae3cf927b6880b, user.id=a13ee61417bf4b1696004d6d73cf2299) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:51.197181 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492e02a-390e-411e-8b62-305e8ba7f485 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:51.198715 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492e02a-390e-411e-8b62-305e8ba7f485 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:51.207314 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18005652-2f27-4efa-9cb7-edc46db3a9bd None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:51.208735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 312/638] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:04:51 2022] GET /identity/v3/role_assignments?user.id=a13ee61417bf4b1696004d6d73cf2299&scope.project.id=11f4749185bf4adba9ae3cf927b6880b&role.id=2889c6a70cf04dfda4618a8374822c11 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:51.337759 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18005652-2f27-4efa-9cb7-edc46db3a9bd None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:51.383345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c69e7-6f74-47c7-8104-1e58dc0683f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:51.383991 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c69e7-6f74-47c7-8104-1e58dc0683f6 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:51.384274 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c69e7-6f74-47c7-8104-1e58dc0683f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:51.384552 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c69e7-6f74-47c7-8104-1e58dc0683f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:51.385357 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c69e7-6f74-47c7-8104-1e58dc0683f6 None admin] RBAC: Adding query filter params (role.id=2889c6a70cf04dfda4618a8374822c11, scope.project.id=11f4749185bf4adba9ae3cf927b6880b, user.id=bd087e64f5714585a53556a8dda546e9) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:51.385670 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c69e7-6f74-47c7-8104-1e58dc0683f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:51.387448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c69e7-6f74-47c7-8104-1e58dc0683f6 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:51.394714 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 327/639] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:04:51 2022] GET /identity/v3/role_assignments?user.id=bd087e64f5714585a53556a8dda546e9&scope.project.id=11f4749185bf4adba9ae3cf927b6880b&role.id=2889c6a70cf04dfda4618a8374822c11 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:51.405649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51e13a-1046-46df-a18e-717b2c89548b None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:51.405997 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51e13a-1046-46df-a18e-717b2c89548b None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:51.406364 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51e13a-1046-46df-a18e-717b2c89548b None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:51.408295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 313/640] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:51.414983 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e1404-c019-414a-a79a-3656dccc82d0 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:51.415357 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e1404-c019-414a-a79a-3656dccc82d0 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:51.415578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e1404-c019-414a-a79a-3656dccc82d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:51.437354 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-875e1404-c019-414a-a79a-3656dccc82d0 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:51.438612 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-875e1404-c019-414a-a79a-3656dccc82d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:51.507764 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:51.525126 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 328/641] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:51.550575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51e13a-1046-46df-a18e-717b2c89548b None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:51.580186 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:51.667588 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51e13a-1046-46df-a18e-717b2c89548b None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:51.703579 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba214c16-7976-4d2c-b809-a448b6d774c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:51.704236 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba214c16-7976-4d2c-b809-a448b6d774c0 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:51.704516 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba214c16-7976-4d2c-b809-a448b6d774c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:51.704790 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba214c16-7976-4d2c-b809-a448b6d774c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:51.717217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba214c16-7976-4d2c-b809-a448b6d774c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:51.722749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-ba214c16-7976-4d2c-b809-a448b6d774c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:04:51.722749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:51.722749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:51.722749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:51.722749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:51.722749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:51.722749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:51.722749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:51.722749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:51.722749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:51.722749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:51.722749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:51.722749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:51.722749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:51.722749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:51.722749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:51.723782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:51.723782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:51.723782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:51.723782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:51.723782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:51.723782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:51.723782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:51.723782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:51.723782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:51.723782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:51.723782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:51.723782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:51.723782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:51.723782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:51.723782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:51.723782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:51.724669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:51.724669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:51.724669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:51.724669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:51.724669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:51.724669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:51.724669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:51.724669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:51.724669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:51.724669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:51.724669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:04:51.724669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:51.724669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 314/642] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Jul 28 11:04:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:51.730293 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e1404-c019-414a-a79a-3656dccc82d0 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:51.838555 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e1404-c019-414a-a79a-3656dccc82d0 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:51.879478 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06823b-2dd6-48d3-8e2a-b49d28527534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:51.880086 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06823b-2dd6-48d3-8e2a-b49d28527534 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:51.880369 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06823b-2dd6-48d3-8e2a-b49d28527534 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:51.880648 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06823b-2dd6-48d3-8e2a-b49d28527534 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:51.881382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06823b-2dd6-48d3-8e2a-b49d28527534 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:51.881691 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06823b-2dd6-48d3-8e2a-b49d28527534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:51.883658 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06823b-2dd6-48d3-8e2a-b49d28527534 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:51.893399 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 329/643] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:51.899286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba214c16-7976-4d2c-b809-a448b6d774c0 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:51.993844 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:52.011626 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba214c16-7976-4d2c-b809-a448b6d774c0 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:52.049650 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688ad0b-4aa0-49d3-ae8e-d7497b284010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:52.050315 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688ad0b-4aa0-49d3-ae8e-d7497b284010 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:52.050593 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688ad0b-4aa0-49d3-ae8e-d7497b284010 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:52.050868 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688ad0b-4aa0-49d3-ae8e-d7497b284010 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:52.062413 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688ad0b-4aa0-49d3-ae8e-d7497b284010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:52.063925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688ad0b-4aa0-49d3-ae8e-d7497b284010 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:52.080047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-f688ad0b-4aa0-49d3-ae8e-d7497b284010 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:52.080047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:52.080047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:52.080047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:52.080047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:52.080047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:52.080047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:52.080047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:52.080047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:52.080047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:52.080047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:52.080047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:52.080047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:52.080047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:52.080047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:52.080951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:52.080951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:52.080951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:52.080951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:52.080951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:52.080951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:52.080951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:52.080951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:52.080951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:52.080951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:52.080951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:52.080951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:52.080951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:52.080951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:52.080951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:52.080951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:52.080951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:52.081846 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:52.081846 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:52.081846 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:52.081846 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:52.081846 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 315/644] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:52.088344 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06823b-2dd6-48d3-8e2a-b49d28527534 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:52.145077 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:52.199530 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06823b-2dd6-48d3-8e2a-b49d28527534 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:52.236106 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8398d-c1be-4a8e-835a-4326c36b9413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:52.236744 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8398d-c1be-4a8e-835a-4326c36b9413 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:52.237031 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8398d-c1be-4a8e-835a-4326c36b9413 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:52.237308 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8398d-c1be-4a8e-835a-4326c36b9413 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:52.238010 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8398d-c1be-4a8e-835a-4326c36b9413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:52.238321 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8398d-c1be-4a8e-835a-4326c36b9413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:52.239724 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8398d-c1be-4a8e-835a-4326c36b9413 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:52.252960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 330/645] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:52.261185 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688ad0b-4aa0-49d3-ae8e-d7497b284010 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:52.387162 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688ad0b-4aa0-49d3-ae8e-d7497b284010 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:52.424186 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2fbbc-f3a6-4959-9eb6-ec7bec44126a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:52.425187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2fbbc-f3a6-4959-9eb6-ec7bec44126a None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:52.425695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2fbbc-f3a6-4959-9eb6-ec7bec44126a None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:52.426256 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2fbbc-f3a6-4959-9eb6-ec7bec44126a None admin] PATH_INFO: `/v3/users/nova` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:52.429996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:52.436559 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2fbbc-f3a6-4959-9eb6-ec7bec44126a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:52.438362 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2fbbc-f3a6-4959-9eb6-ec7bec44126a None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:52.450595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-90c2fbbc-f3a6-4959-9eb6-ec7bec44126a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 11:04:52.450595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:52.450595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:52.450595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:52.450595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:52.450595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:52.450595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:52.450595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:52.450595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:52.450595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:52.450595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:52.450595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:52.450595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:04:52.450595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:04:52.450595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:04:52.450595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:04:52.451620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:52.451620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:52.451620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:04:52.451620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:52.451620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:04:52.451620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:52.451620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:52.451620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:52.451620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:52.451620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:52.451620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:52.451620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:52.451620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:52.451620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:52.451620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:52.451620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:52.451620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:52.451620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:52.452612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:52.452612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:52.452612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:04:52.452612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:04:52.452612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:04:52.452612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:04:52.452612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:04:52.452612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:04:52.452612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 11:04:52.452612 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:52.459442 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 316/646] 10.222.0.71 () {56 vars in 1093 bytes} [Thu Jul 28 11:04:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:52.461832 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8398d-c1be-4a8e-835a-4326c36b9413 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:52.574236 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8398d-c1be-4a8e-835a-4326c36b9413 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:52.585786 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:52.610865 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56d903-24e7-46e1-9bc7-eac8ed7e0410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:52.611549 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56d903-24e7-46e1-9bc7-eac8ed7e0410 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:52.611823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56d903-24e7-46e1-9bc7-eac8ed7e0410 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:52.612105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56d903-24e7-46e1-9bc7-eac8ed7e0410 None admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:52.612911 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56d903-24e7-46e1-9bc7-eac8ed7e0410 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:52.613222 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56d903-24e7-46e1-9bc7-eac8ed7e0410 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:52.614676 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56d903-24e7-46e1-9bc7-eac8ed7e0410 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:52.635151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 331/647] 10.222.0.71 () {56 vars in 1133 bytes} [Thu Jul 28 11:04:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:52.641219 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2fbbc-f3a6-4959-9eb6-ec7bec44126a None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:52.765972 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2fbbc-f3a6-4959-9eb6-ec7bec44126a None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:52.802937 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9ca6c-8dce-4be3-bb73-21fd768df60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:52.803601 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9ca6c-8dce-4be3-bb73-21fd768df60c None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:52.803921 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9ca6c-8dce-4be3-bb73-21fd768df60c None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:52.804773 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9ca6c-8dce-4be3-bb73-21fd768df60c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:52.875075 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:52.882092 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9ca6c-8dce-4be3-bb73-21fd768df60c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:52.883599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9ca6c-8dce-4be3-bb73-21fd768df60c None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:52.987363 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 317/648] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 11:04:52.995820 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56d903-24e7-46e1-9bc7-eac8ed7e0410 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:52.997020 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b36fd0-0e65-4bcd-a3fc-b79e56f3fdac None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:52.997313 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b36fd0-0e65-4bcd-a3fc-b79e56f3fdac None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:52.997593 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b36fd0-0e65-4bcd-a3fc-b79e56f3fdac None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:52.999214 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 318/649] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:04:53.004435 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e100978-5fee-495f-85c2-a029c2b233ae None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:53.004721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e100978-5fee-495f-85c2-a029c2b233ae None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:53.005005 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e100978-5fee-495f-85c2-a029c2b233ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:53.026458 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-4e100978-5fee-495f-85c2-a029c2b233ae None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:53.027801 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-4e100978-5fee-495f-85c2-a029c2b233ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:53.115391 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 319/650] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:04:53.129254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56d903-24e7-46e1-9bc7-eac8ed7e0410 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:53.141896 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e100978-5fee-495f-85c2-a029c2b233ae None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:53.175697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:53.181228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88213c6d-8fd7-4a34-963a-c196ae9d6e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:53.181909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88213c6d-8fd7-4a34-963a-c196ae9d6e86 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:53.182196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88213c6d-8fd7-4a34-963a-c196ae9d6e86 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:53.182475 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88213c6d-8fd7-4a34-963a-c196ae9d6e86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:53.196779 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88213c6d-8fd7-4a34-963a-c196ae9d6e86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:53.198854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88213c6d-8fd7-4a34-963a-c196ae9d6e86 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:53.220331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-88213c6d-8fd7-4a34-963a-c196ae9d6e86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:53.220331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:53.220331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:53.220331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:53.220331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:53.220331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:53.220331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:53.220331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:53.220331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:53.220331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:53.220331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:53.220331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:53.220331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:53.220331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:53.220331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:53.221302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:53.221302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:53.221302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:53.221302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:53.221302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:53.221302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:53.221302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:53.221302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:53.221302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:53.221302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:53.221302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:53.221302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:53.221302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:53.221302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:53.221302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:53.221302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:53.221302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:53.222181 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:53.222181 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:53.222181 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:53.222181 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:53.222181 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 332/651] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:53.229453 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88213c6d-8fd7-4a34-963a-c196ae9d6e86 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:53.260657 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:53.285546 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e100978-5fee-495f-85c2-a029c2b233ae None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:53.334231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccadfe6-f7fb-459f-9ec5-4fb020e15d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:53.334896 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccadfe6-f7fb-459f-9ec5-4fb020e15d98 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:53.335202 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccadfe6-f7fb-459f-9ec5-4fb020e15d98 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:53.336184 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccadfe6-f7fb-459f-9ec5-4fb020e15d98 None admin] PATH_INFO: `/v3/services/image` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:53.336883 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccadfe6-f7fb-459f-9ec5-4fb020e15d98 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:53.338981 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccadfe6-f7fb-459f-9ec5-4fb020e15d98 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:53.354858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-dccadfe6-f7fb-459f-9ec5-4fb020e15d98 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 11:04:53.354858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:53.354858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:04:53.354858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:04:53.354858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:04:53.354858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:04:53.354858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:04:53.354858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:04:53.354858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 11:04:53.354858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:53.354858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:04:53.354858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:53.354858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:53.354858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:53.354858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:53.354858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:53.354858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:53.355978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:53.355978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:53.355978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:53.355978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:53.355978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:53.355978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:53.355978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:04:53.355978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:04:53.355978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:04:53.355978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:04:53.355978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:53.355978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:53.355978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:53.355978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:53.355978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:53.355978 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:53.356805 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:53.356805 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:53.356805 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:53.356805 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:53.356805 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:53.356805 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:53.356805 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:53.356805 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:53.356805 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:53.356805 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:53.356805 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:04:53.356805 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:04:53.356805 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 11:04:53.356805 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:53.359357 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 320/652] 10.222.0.71 () {56 vars in 1105 bytes} [Thu Jul 28 11:04:53 2022] GET /identity/v3/services/image => generated 86 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:04:53.362356 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccadfe6-f7fb-459f-9ec5-4fb020e15d98 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:53.380896 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88213c6d-8fd7-4a34-963a-c196ae9d6e86 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:53.422902 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd8d83-6d61-4c29-88ff-e20e277e7944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:53.423781 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd8d83-6d61-4c29-88ff-e20e277e7944 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:53.424134 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd8d83-6d61-4c29-88ff-e20e277e7944 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:53.424529 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd8d83-6d61-4c29-88ff-e20e277e7944 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:53.425470 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd8d83-6d61-4c29-88ff-e20e277e7944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:53.425825 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd8d83-6d61-4c29-88ff-e20e277e7944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:53.427328 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd8d83-6d61-4c29-88ff-e20e277e7944 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:53.446657 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 333/653] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:53.448034 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd8d83-6d61-4c29-88ff-e20e277e7944 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:53.475792 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:53.486973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccadfe6-f7fb-459f-9ec5-4fb020e15d98 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:53.532128 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed0c49-454c-43bd-9f3f-24cdb4376f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:53.533164 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed0c49-454c-43bd-9f3f-24cdb4376f0a None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:53.533673 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed0c49-454c-43bd-9f3f-24cdb4376f0a None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:53.534329 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed0c49-454c-43bd-9f3f-24cdb4376f0a None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:53.535976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed0c49-454c-43bd-9f3f-24cdb4376f0a None admin] RBAC: Adding query filter params (name=image) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:53.536613 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed0c49-454c-43bd-9f3f-24cdb4376f0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:53.539497 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed0c49-454c-43bd-9f3f-24cdb4376f0a None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:53.549674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 321/654] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:53.550319 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:53.551865 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed0c49-454c-43bd-9f3f-24cdb4376f0a None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:53.567972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd8d83-6d61-4c29-88ff-e20e277e7944 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:53.607856 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39451f93-0740-4cd5-b9cb-c7b7aef4d868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:53.608514 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39451f93-0740-4cd5-b9cb-c7b7aef4d868 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:53.608928 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39451f93-0740-4cd5-b9cb-c7b7aef4d868 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:53.609235 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39451f93-0740-4cd5-b9cb-c7b7aef4d868 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:53.617787 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39451f93-0740-4cd5-b9cb-c7b7aef4d868 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:53.619249 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39451f93-0740-4cd5-b9cb-c7b7aef4d868 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:53.633168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-39451f93-0740-4cd5-b9cb-c7b7aef4d868 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:53.633168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:53.633168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:53.633168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:53.633168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:53.633168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:53.633168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:53.633168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:53.633168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:53.633168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:53.633168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:53.633168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:53.633168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:04:53.633168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:04:53.633168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:04:53.634103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:04:53.634103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:53.634103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:53.634103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:53.634103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:53.634103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:53.634103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:53.634103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:53.634103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:53.634103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:53.634103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:53.634103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:53.634103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:53.634103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:53.634103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:53.634103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:53.634103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:53.635075 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:04:53.635075 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:04:53.635075 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:04:53.635075 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:04:53.635075 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:04:53.635075 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:04:53.635075 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:53.635075 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:53.639505 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 334/655] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:04:53.640520 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39451f93-0740-4cd5-b9cb-c7b7aef4d868 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:53.670915 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed0c49-454c-43bd-9f3f-24cdb4376f0a None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:53.710884 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c165f-d63b-47aa-9726-fd9e51385dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:53.712050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c165f-d63b-47aa-9726-fd9e51385dad None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:53.712544 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c165f-d63b-47aa-9726-fd9e51385dad None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:53.713025 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c165f-d63b-47aa-9726-fd9e51385dad None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:53.714069 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c165f-d63b-47aa-9726-fd9e51385dad None admin] RBAC: Adding query filter params (type=image) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:53.714761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c165f-d63b-47aa-9726-fd9e51385dad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:53.716556 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c165f-d63b-47aa-9726-fd9e51385dad None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:53.731519 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 322/656] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:53.765897 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39451f93-0740-4cd5-b9cb-c7b7aef4d868 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:53.806948 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280e191-b56e-4707-a677-9eb3e994beb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:53.807740 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280e191-b56e-4707-a677-9eb3e994beb9 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:53.808029 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280e191-b56e-4707-a677-9eb3e994beb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:53.808404 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280e191-b56e-4707-a677-9eb3e994beb9 None admin] PATH_INFO: `/v3/projects` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:53.809280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280e191-b56e-4707-a677-9eb3e994beb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:53.809596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280e191-b56e-4707-a677-9eb3e994beb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:53.811213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280e191-b56e-4707-a677-9eb3e994beb9 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:53.826215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:53.831041 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 335/657] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:04:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:53.838107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c165f-d63b-47aa-9726-fd9e51385dad None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:53.861663 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:53.874026 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d55b51-7a6b-494a-85f9-0ce1932507ce None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:53.874359 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d55b51-7a6b-494a-85f9-0ce1932507ce None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:53.874586 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d55b51-7a6b-494a-85f9-0ce1932507ce None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:53.876291 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 336/658] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:04:53.881726 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15948f2c-cb28-44b5-b506-4b224e3791e1 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:53.882053 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15948f2c-cb28-44b5-b506-4b224e3791e1 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:53.882926 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15948f2c-cb28-44b5-b506-4b224e3791e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:53.902335 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-15948f2c-cb28-44b5-b506-4b224e3791e1 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:53.903923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-15948f2c-cb28-44b5-b506-4b224e3791e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:53.967830 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c165f-d63b-47aa-9726-fd9e51385dad None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:53.985547 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 337/659] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:04:53.987302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024d6d2-2156-410e-bf48-bed91b472dd3 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:53.987302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024d6d2-2156-410e-bf48-bed91b472dd3 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:53.987501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024d6d2-2156-410e-bf48-bed91b472dd3 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:53.991931 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 338/660] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:53.994724 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ef32-d6b1-4a2b-bf56-e2f60ed78bb8 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:53.995015 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ef32-d6b1-4a2b-bf56-e2f60ed78bb8 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:53.995326 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ef32-d6b1-4a2b-bf56-e2f60ed78bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:54.011042 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e75aae-c724-4957-a269-a63fb8d14e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:54.012686 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e75aae-c724-4957-a269-a63fb8d14e4a None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:54.013176 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e75aae-c724-4957-a269-a63fb8d14e4a None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:54.013659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e75aae-c724-4957-a269-a63fb8d14e4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:54.014602 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-6ab7ef32-d6b1-4a2b-bf56-e2f60ed78bb8 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:54.014961 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e75aae-c724-4957-a269-a63fb8d14e4a None admin] RBAC: Adding query filter params (role.id=f2a8452a65264f9ea10467160b1bd735, scope.project.id=11f4749185bf4adba9ae3cf927b6880b, user.id=2bf7f66ba696444f8055a498e292a182) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:54.015497 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e75aae-c724-4957-a269-a63fb8d14e4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:54.015859 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-6ab7ef32-d6b1-4a2b-bf56-e2f60ed78bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:54.016962 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e75aae-c724-4957-a269-a63fb8d14e4a None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:54.024344 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 323/661] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:04:53 2022] GET /identity/v3/role_assignments?user.id=2bf7f66ba696444f8055a498e292a182&scope.project.id=11f4749185bf4adba9ae3cf927b6880b&role.id=f2a8452a65264f9ea10467160b1bd735 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:54.032491 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e75aae-c724-4957-a269-a63fb8d14e4a None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:54.099969 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 339/662] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:04:54.123979 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ef32-d6b1-4a2b-bf56-e2f60ed78bb8 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:54.155152 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:54.186015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e75aae-c724-4957-a269-a63fb8d14e4a None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:54.207397 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:54.230005 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0eff67-b7ab-44a2-83e3-f6510b87e4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:54.230674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0eff67-b7ab-44a2-83e3-f6510b87e4ad None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:54.230961 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0eff67-b7ab-44a2-83e3-f6510b87e4ad None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:54.231241 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0eff67-b7ab-44a2-83e3-f6510b87e4ad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:54.232095 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0eff67-b7ab-44a2-83e3-f6510b87e4ad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:54.233696 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0eff67-b7ab-44a2-83e3-f6510b87e4ad None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:54.243469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-9e0eff67-b7ab-44a2-83e3-f6510b87e4ad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 11:04:54.243469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:54.243469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:04:54.243469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:04:54.243469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:04:54.243469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:04:54.243469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:04:54.243469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:04:54.243469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 11:04:54.243469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:54.243469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:04:54.243469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:54.243469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:54.243469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:54.243469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:54.243469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:54.244481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:54.244481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:54.244481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:54.244481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:54.244481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:54.244481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:54.244481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:54.244481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:04:54.244481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:04:54.244481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:04:54.244481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:04:54.244481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:54.244481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:54.244481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:54.244481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:54.244481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:54.245295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:54.245295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:54.245295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:54.245295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:54.245295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:54.245295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:54.245295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:54.245295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:54.245295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:54.245295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:54.245295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:54.245295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:04:54.245295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:04:54.245295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 11:04:54.245295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:54.245295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 324/663] 10.222.0.71 () {56 vars in 1129 bytes} [Thu Jul 28 11:04:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:54.255595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0eff67-b7ab-44a2-83e3-f6510b87e4ad None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:54.271888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ef32-d6b1-4a2b-bf56-e2f60ed78bb8 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:54.321733 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421fffc-b353-4259-9701-44f70b01f5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:54.323213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421fffc-b353-4259-9701-44f70b01f5a6 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:54.323740 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421fffc-b353-4259-9701-44f70b01f5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:54.325107 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421fffc-b353-4259-9701-44f70b01f5a6 None admin] PATH_INFO: `/v3/services/network` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:54.326497 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421fffc-b353-4259-9701-44f70b01f5a6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:54.329823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421fffc-b353-4259-9701-44f70b01f5a6 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:54.351411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-8421fffc-b353-4259-9701-44f70b01f5a6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 11:04:54.351411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:54.351411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:04:54.351411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:04:54.351411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:04:54.351411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:04:54.351411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:04:54.351411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:04:54.351411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 11:04:54.351411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:54.351411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:04:54.351411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:54.351411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:54.351411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:54.351411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:54.351411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:54.351411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:54.353280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:54.353280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:54.353280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:54.353280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:54.353280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:54.353280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:54.353280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:04:54.353280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:04:54.353280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:04:54.353280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:04:54.353280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:54.353280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:54.353280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:54.353280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:54.353280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:54.353280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:54.354861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:54.354861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:54.354861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:54.354861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:54.354861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:54.354861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:54.354861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:54.354861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:54.354861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:54.354861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:54.354861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:04:54.354861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:04:54.354861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 11:04:54.354861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:54.357863 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 340/664] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:54 2022] GET /identity/v3/services/network => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:04:54.358796 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421fffc-b353-4259-9701-44f70b01f5a6 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:54.421136 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0eff67-b7ab-44a2-83e3-f6510b87e4ad None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:54.465384 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421fffc-b353-4259-9701-44f70b01f5a6 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:54.486977 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c8e21-27b3-42e1-80c1-97685388c0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:54.488489 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c8e21-27b3-42e1-80c1-97685388c0ca None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:54.489341 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c8e21-27b3-42e1-80c1-97685388c0ca None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:54.490023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:54.491299 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c8e21-27b3-42e1-80c1-97685388c0ca None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:54.493942 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c8e21-27b3-42e1-80c1-97685388c0ca None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:54.495357 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c8e21-27b3-42e1-80c1-97685388c0ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:54.498813 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c8e21-27b3-42e1-80c1-97685388c0ca None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:54.504600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0c435-3025-4aa0-854f-9a197788d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:54.505224 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0c435-3025-4aa0-854f-9a197788d3ab None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:54.505561 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0c435-3025-4aa0-854f-9a197788d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:54.505831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0c435-3025-4aa0-854f-9a197788d3ab None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:54.506507 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0c435-3025-4aa0-854f-9a197788d3ab None admin] RBAC: Adding query filter params (name=network) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:54.506805 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0c435-3025-4aa0-854f-9a197788d3ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:54.508784 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0c435-3025-4aa0-854f-9a197788d3ab None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:54.515815 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 325/666] 10.222.0.71 () {56 vars in 1124 bytes} [Thu Jul 28 11:04:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:54.518226 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 341/666] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Jul 28 11:04:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:54.519158 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0c435-3025-4aa0-854f-9a197788d3ab None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:54.520100 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c8e21-27b3-42e1-80c1-97685388c0ca None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:54.545134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:54.668648 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c8e21-27b3-42e1-80c1-97685388c0ca None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:54.687601 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0c435-3025-4aa0-854f-9a197788d3ab None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:54.710416 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb79b88-df17-40ff-976f-dae23e72ee68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:54.711048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb79b88-df17-40ff-976f-dae23e72ee68 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:54.711407 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb79b88-df17-40ff-976f-dae23e72ee68 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:54.711686 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb79b88-df17-40ff-976f-dae23e72ee68 None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:54.712363 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb79b88-df17-40ff-976f-dae23e72ee68 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:54.712655 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb79b88-df17-40ff-976f-dae23e72ee68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:54.714400 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb79b88-df17-40ff-976f-dae23e72ee68 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:54.727298 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 326/667] 10.222.0.71 () {56 vars in 1124 bytes} [Thu Jul 28 11:04:54 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:54.746986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968cc76-4e56-48c8-b3fa-92d581330122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:54.747660 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968cc76-4e56-48c8-b3fa-92d581330122 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:54.747936 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968cc76-4e56-48c8-b3fa-92d581330122 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:54.748212 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968cc76-4e56-48c8-b3fa-92d581330122 None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:54.748906 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968cc76-4e56-48c8-b3fa-92d581330122 None admin] RBAC: Adding query filter params (type=network) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:54.749211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968cc76-4e56-48c8-b3fa-92d581330122 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:54.750879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968cc76-4e56-48c8-b3fa-92d581330122 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:54.758647 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 342/668] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Jul 28 11:04:54 2022] GET /identity/v3/services?type=network => generated 124 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:56.235618 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50651c3-af92-4b3f-bf3c-0fbbee64adcb None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:56.236188 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50651c3-af92-4b3f-bf3c-0fbbee64adcb None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:56.236188 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50651c3-af92-4b3f-bf3c-0fbbee64adcb None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:56.237983 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 327/669] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:56.244629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10298d-6822-4eb2-9939-700f25c76926 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:56.245141 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10298d-6822-4eb2-9939-700f25c76926 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:56.245218 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10298d-6822-4eb2-9939-700f25c76926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:56.266765 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-6d10298d-6822-4eb2-9939-700f25c76926 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:56.268054 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-6d10298d-6822-4eb2-9939-700f25c76926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:56.331099 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:56.370917 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 343/670] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:56.400149 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50651c3-af92-4b3f-bf3c-0fbbee64adcb None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:56.503940 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:56.532746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50651c3-af92-4b3f-bf3c-0fbbee64adcb None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:56.568147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef6c34-b4bd-491b-b4f8-f5d5727ccb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:56.568779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef6c34-b4bd-491b-b4f8-f5d5727ccb80 None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:56.569060 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef6c34-b4bd-491b-b4f8-f5d5727ccb80 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:56.569333 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef6c34-b4bd-491b-b4f8-f5d5727ccb80 None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:56.570634 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef6c34-b4bd-491b-b4f8-f5d5727ccb80 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:56.572257 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef6c34-b4bd-491b-b4f8-f5d5727ccb80 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:56.590726 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 328/671] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Jul 28 11:04:56 2022] POST /identity/v3/services => generated 242 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:04:56.609333 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558de039-87cf-43a7-8b62-78e27421f529 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:56.609665 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558de039-87cf-43a7-8b62-78e27421f529 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:56.609954 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558de039-87cf-43a7-8b62-78e27421f529 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:56.611789 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 344/672] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:56.617815 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fe1bd-f933-40d6-8983-a0da4e6f422b None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:56.618146 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fe1bd-f933-40d6-8983-a0da4e6f422b None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:56.618380 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fe1bd-f933-40d6-8983-a0da4e6f422b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:56.639846 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-251fe1bd-f933-40d6-8983-a0da4e6f422b None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:56.641062 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-251fe1bd-f933-40d6-8983-a0da4e6f422b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:56.734384 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 329/673] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:56 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:56.758777 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558de039-87cf-43a7-8b62-78e27421f529 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:56.876873 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558de039-87cf-43a7-8b62-78e27421f529 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:56.914954 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b064c-eea9-445a-8fc4-edfc61afd723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:56.916030 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b064c-eea9-445a-8fc4-edfc61afd723 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:56.916541 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b064c-eea9-445a-8fc4-edfc61afd723 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:56.917019 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b064c-eea9-445a-8fc4-edfc61afd723 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:56.931923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b064c-eea9-445a-8fc4-edfc61afd723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:04:56.937517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-465b064c-eea9-445a-8fc4-edfc61afd723 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:04:56.937517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:56.937517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:56.937517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:56.937517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:56.937517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:56.937517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:56.937517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:56.937517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:56.937517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:56.937517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:56.937517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:56.937517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:04:56.937517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:04:56.937517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:04:56.937517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:04:56.938516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:04:56.938516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:04:56.938516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:04:56.938516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:04:56.938516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:56.938516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:56.938516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:56.938516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:56.938516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:56.938516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:56.938516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:56.938516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:56.938516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:56.938516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:56.938516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:56.938516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:56.939392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:56.939392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:56.939392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:56.939392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:56.939392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:04:56.939392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:04:56.939392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:04:56.939392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:04:56.939392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:04:56.939392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:04:56.939392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:04:56.939392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:56.942233 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 345/674] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Jul 28 11:04:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:56.947773 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fe1bd-f933-40d6-8983-a0da4e6f422b None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:57.009899 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:57.059641 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fe1bd-f933-40d6-8983-a0da4e6f422b None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:57.102692 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df8d0a-b7a2-4d2c-a167-2c178dadbaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:57.103432 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df8d0a-b7a2-4d2c-a167-2c178dadbaeb None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:57.103722 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df8d0a-b7a2-4d2c-a167-2c178dadbaeb None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:57.104001 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df8d0a-b7a2-4d2c-a167-2c178dadbaeb None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:57.104741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df8d0a-b7a2-4d2c-a167-2c178dadbaeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:57.105053 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df8d0a-b7a2-4d2c-a167-2c178dadbaeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:57.106461 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df8d0a-b7a2-4d2c-a167-2c178dadbaeb None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:57.117109 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 330/675] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:04:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:57.122274 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b064c-eea9-445a-8fc4-edfc61afd723 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:57.170579 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:57.223093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19071403-beb9-4915-90d1-4b93f83fa3f6 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:57.223093 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19071403-beb9-4915-90d1-4b93f83fa3f6 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:57.223428 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19071403-beb9-4915-90d1-4b93f83fa3f6 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:57.225159 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 331/676] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:04:57.231155 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ada2b7-83a7-44a7-9dd7-f615ffad82e2 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:57.231481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ada2b7-83a7-44a7-9dd7-f615ffad82e2 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:57.231762 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ada2b7-83a7-44a7-9dd7-f615ffad82e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:57.241576 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b064c-eea9-445a-8fc4-edfc61afd723 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:57.254181 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-d5ada2b7-83a7-44a7-9dd7-f615ffad82e2 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:57.256702 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-d5ada2b7-83a7-44a7-9dd7-f615ffad82e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:57.285265 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822a508-9e79-4486-8b9c-70e03354ad9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:57.286735 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822a508-9e79-4486-8b9c-70e03354ad9f None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:57.287379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822a508-9e79-4486-8b9c-70e03354ad9f None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:57.287750 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822a508-9e79-4486-8b9c-70e03354ad9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:57.302770 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822a508-9e79-4486-8b9c-70e03354ad9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:57.304971 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822a508-9e79-4486-8b9c-70e03354ad9f None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:57.320550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-1822a508-9e79-4486-8b9c-70e03354ad9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:57.320550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:57.320550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:57.320550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:57.320550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:57.320550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:57.320550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:57.320550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:57.320550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:57.320550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:57.320550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:57.320550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:57.320550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:57.320550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:57.320550 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:57.321566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:57.321566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:57.321566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:57.321566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:57.321566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:57.321566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:57.321566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:57.321566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:57.321566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:57.321566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:57.321566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:57.321566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:57.321566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:57.321566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:57.321566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:57.321566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:57.321566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:57.322497 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:57.322497 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:57.322497 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:57.322497 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:04:57.322497 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 346/677] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:57.323415 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952cb49-99fd-4782-b5c2-ceb700e9a448 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:57.323415 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952cb49-99fd-4782-b5c2-ceb700e9a448 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:57.323602 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952cb49-99fd-4782-b5c2-ceb700e9a448 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:57.326383 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 347/678] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:57.328008 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952cb49-99fd-4782-b5c2-ceb700e9a448 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:57.337605 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 332/679] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:57 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 11:04:57.339015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1c270-c7d0-4a96-aa09-78d61a3da8bb None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:57.339132 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1c270-c7d0-4a96-aa09-78d61a3da8bb None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:57.339447 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1c270-c7d0-4a96-aa09-78d61a3da8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:57.367656 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-42f1c270-c7d0-4a96-aa09-78d61a3da8bb None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:57.369166 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-42f1c270-c7d0-4a96-aa09-78d61a3da8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:57.423186 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:57.436173 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:57.452246 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952cb49-99fd-4782-b5c2-ceb700e9a448 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:57.452430 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 333/680] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:57 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 11:04:57.452430 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1c270-c7d0-4a96-aa09-78d61a3da8bb None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:57.495973 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712dbe60-199e-41c4-ab0c-c8b1b4937850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:57.496595 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dbe60-199e-41c4-ab0c-c8b1b4937850 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:57.496870 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dbe60-199e-41c4-ab0c-c8b1b4937850 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:57.497575 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dbe60-199e-41c4-ab0c-c8b1b4937850 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:57.498279 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712dbe60-199e-41c4-ab0c-c8b1b4937850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:57.498583 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712dbe60-199e-41c4-ab0c-c8b1b4937850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:57.500637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712dbe60-199e-41c4-ab0c-c8b1b4937850 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:57.517968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 348/681] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:57.517968 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712dbe60-199e-41c4-ab0c-c8b1b4937850 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:57.567624 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1c270-c7d0-4a96-aa09-78d61a3da8bb None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:57.609828 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50d952-63d4-4c67-827b-e336f2615568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:57.610868 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50d952-63d4-4c67-827b-e336f2615568 None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:57.611478 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50d952-63d4-4c67-827b-e336f2615568 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:57.611916 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50d952-63d4-4c67-827b-e336f2615568 None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:57.612676 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50d952-63d4-4c67-827b-e336f2615568 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:57.615253 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50d952-63d4-4c67-827b-e336f2615568 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:57.633686 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 334/682] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Jul 28 11:04:57 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:04:57.634988 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50d952-63d4-4c67-827b-e336f2615568 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:57.636304 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712dbe60-199e-41c4-ab0c-c8b1b4937850 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:57.690035 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:57.696392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb9621-d5ca-41aa-879d-1f915eee0dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:57.697390 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb9621-d5ca-41aa-879d-1f915eee0dfe None admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:57.698832 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb9621-d5ca-41aa-879d-1f915eee0dfe None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:57.699316 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb9621-d5ca-41aa-879d-1f915eee0dfe None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:57.700432 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb9621-d5ca-41aa-879d-1f915eee0dfe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:57.702159 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb9621-d5ca-41aa-879d-1f915eee0dfe None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:57.723247 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 349/683] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Jul 28 11:04:57 2022] POST /identity/v3/services => generated 240 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:04:57.776522 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50d952-63d4-4c67-827b-e336f2615568 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:57.832163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5281b-e8b2-47d7-b474-30eeef4c1786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:57.832833 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5281b-e8b2-47d7-b474-30eeef4c1786 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:57.833126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5281b-e8b2-47d7-b474-30eeef4c1786 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:57.833402 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5281b-e8b2-47d7-b474-30eeef4c1786 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:57.844655 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5281b-e8b2-47d7-b474-30eeef4c1786 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:57.846747 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5281b-e8b2-47d7-b474-30eeef4c1786 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:57.862806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-9ba5281b-e8b2-47d7-b474-30eeef4c1786 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 11:04:57.862806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:57.862806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:57.862806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:57.862806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:57.862806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:57.862806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:57.862806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:57.862806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:57.862806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:57.862806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:57.862806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:57.862806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:04:57.862806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:04:57.862806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:04:57.862806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:04:57.864041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:57.864041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:57.864041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:04:57.864041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:57.864041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:04:57.864041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:04:57.864041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:57.864041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:57.864041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:57.864041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:57.864041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:57.864041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:57.864041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:57.864041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:57.864041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:57.864041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:57.864041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:57.864041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:57.865187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:57.865187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:57.865187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:04:57.865187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:04:57.865187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:04:57.865187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:04:57.865187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:04:57.865187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:04:57.865187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 11:04:57.865187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:57.865187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 335/684] 10.222.0.71 () {56 vars in 1093 bytes} [Thu Jul 28 11:04:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:57.871052 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb9621-d5ca-41aa-879d-1f915eee0dfe None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:57.895803 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:57.998080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb9621-d5ca-41aa-879d-1f915eee0dfe None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:58.036452 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a3f1c-bc4e-462c-85ef-9b854bdb2d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:58.037095 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a3f1c-bc4e-462c-85ef-9b854bdb2d51 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:58.037404 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a3f1c-bc4e-462c-85ef-9b854bdb2d51 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:58.037694 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a3f1c-bc4e-462c-85ef-9b854bdb2d51 None admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:58.038645 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a3f1c-bc4e-462c-85ef-9b854bdb2d51 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:58.039000 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a3f1c-bc4e-462c-85ef-9b854bdb2d51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:58.040609 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a3f1c-bc4e-462c-85ef-9b854bdb2d51 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:58.060601 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 350/685] 10.222.0.71 () {56 vars in 1133 bytes} [Thu Jul 28 11:04:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:58.066367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5281b-e8b2-47d7-b474-30eeef4c1786 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:58.177166 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5281b-e8b2-47d7-b474-30eeef4c1786 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:58.179709 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:58.215207 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06c5f4-16eb-43c9-ac9b-3488ebcf1f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:58.216605 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06c5f4-16eb-43c9-ac9b-3488ebcf1f25 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:58.217213 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06c5f4-16eb-43c9-ac9b-3488ebcf1f25 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:58.217695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06c5f4-16eb-43c9-ac9b-3488ebcf1f25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:58.230027 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06c5f4-16eb-43c9-ac9b-3488ebcf1f25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:58.231919 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06c5f4-16eb-43c9-ac9b-3488ebcf1f25 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:58.249539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-8e06c5f4-16eb-43c9-ac9b-3488ebcf1f25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:58.249539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:58.249539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:58.249539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:58.249539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:58.249539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:58.249539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:58.249539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:58.249539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:58.249539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:58.249539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:58.249539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:58.249539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:04:58.249539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:04:58.249539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:04:58.250506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:04:58.250506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:58.250506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:58.250506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:58.250506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:58.250506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:58.250506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:58.250506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:58.250506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:58.250506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:58.250506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:58.250506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:58.250506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:58.250506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:58.250506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:58.250506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:58.250506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:58.251434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:04:58.251434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:04:58.251434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:04:58.251434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:58.253793 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 336/686] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:58.260246 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a3f1c-bc4e-462c-85ef-9b854bdb2d51 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:58.354050 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:58.414311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a3f1c-bc4e-462c-85ef-9b854bdb2d51 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:58.455847 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33947ac-c0ef-4ec3-bddb-324d270f7a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:58.456446 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33947ac-c0ef-4ec3-bddb-324d270f7a12 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:58.456890 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33947ac-c0ef-4ec3-bddb-324d270f7a12 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:58.457170 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33947ac-c0ef-4ec3-bddb-324d270f7a12 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:58.458151 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33947ac-c0ef-4ec3-bddb-324d270f7a12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:58.458511 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33947ac-c0ef-4ec3-bddb-324d270f7a12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:58.460684 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33947ac-c0ef-4ec3-bddb-324d270f7a12 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:58.474671 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 351/687] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:58.481178 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06c5f4-16eb-43c9-ac9b-3488ebcf1f25 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:58.591135 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06c5f4-16eb-43c9-ac9b-3488ebcf1f25 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:58.626384 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e64a43-2618-43a1-8e41-ec7e8162a447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:58.627098 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e64a43-2618-43a1-8e41-ec7e8162a447 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:58.627419 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e64a43-2618-43a1-8e41-ec7e8162a447 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:58.627693 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e64a43-2618-43a1-8e41-ec7e8162a447 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:58.635647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e64a43-2618-43a1-8e41-ec7e8162a447 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:58.637524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e64a43-2618-43a1-8e41-ec7e8162a447 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:58.650895 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-e6e64a43-2618-43a1-8e41-ec7e8162a447 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:58.650895 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:58.650895 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:58.650895 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:58.650895 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:58.650895 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:58.650895 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:58.650895 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:58.650895 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:58.650895 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:58.650895 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:58.650895 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:58.650895 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:04:58.650895 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:04:58.650895 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:04:58.651852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:04:58.651852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:58.651852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:58.651852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:58.651852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:58.651852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:58.651852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:58.651852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:58.651852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:58.651852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:58.651852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:58.651852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:58.651852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:58.651852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:58.651852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:58.651852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:58.651852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:58.653152 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:04:58.653152 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:04:58.653152 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:04:58.653152 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:04:58.653152 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:04:58.653152 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:04:58.653152 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:04:58.653152 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:58.653152 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 337/688] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:04:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:58.658108 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33947ac-c0ef-4ec3-bddb-324d270f7a12 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:58.770328 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33947ac-c0ef-4ec3-bddb-324d270f7a12 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:58.807869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6446b45-0c45-45ea-8a4e-2593f56468c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:58.809532 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:58.810607 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6446b45-0c45-45ea-8a4e-2593f56468c1 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:58.811215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6446b45-0c45-45ea-8a4e-2593f56468c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:58.811737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6446b45-0c45-45ea-8a4e-2593f56468c1 None admin] PATH_INFO: `/v3/projects` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:58.812729 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6446b45-0c45-45ea-8a4e-2593f56468c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:58.813264 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6446b45-0c45-45ea-8a4e-2593f56468c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:58.815343 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6446b45-0c45-45ea-8a4e-2593f56468c1 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:58.839635 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 352/689] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:04:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:58.843766 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e64a43-2618-43a1-8e41-ec7e8162a447 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:58.880931 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:58.983627 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115bcf6-c0ec-4a3a-8ab1-934920fa0c90 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:58.983933 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115bcf6-c0ec-4a3a-8ab1-934920fa0c90 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:58.984213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115bcf6-c0ec-4a3a-8ab1-934920fa0c90 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:58.985935 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 353/690] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:04:58.994726 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c439b-a9b8-414e-a801-ecf3c233fe52 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:58.995410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c439b-a9b8-414e-a801-ecf3c233fe52 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:58.995899 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c439b-a9b8-414e-a801-ecf3c233fe52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:59.014984 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-572c439b-a9b8-414e-a801-ecf3c233fe52 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:04:59.016586 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-572c439b-a9b8-414e-a801-ecf3c233fe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:04:59.017853 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e64a43-2618-43a1-8e41-ec7e8162a447 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:59.071293 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4392f9-148d-41e8-933c-6a38bb63f3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:59.071293 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4392f9-148d-41e8-933c-6a38bb63f3e7 None admin] REQUEST_METHOD: `PUT` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:59.071293 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4392f9-148d-41e8-933c-6a38bb63f3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:59.071293 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4392f9-148d-41e8-933c-6a38bb63f3e7 None admin] PATH_INFO: `/v3/projects/11f4749185bf4adba9ae3cf927b6880b/users/2bf7f66ba696444f8055a498e292a182/roles/f2a8452a65264f9ea10467160b1bd735` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:59.071738 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4392f9-148d-41e8-933c-6a38bb63f3e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=11f4749185bf4adba9ae3cf927b6880b, user_id=2bf7f66ba696444f8055a498e292a182, role_id=f2a8452a65264f9ea10467160b1bd735)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:59.072488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4392f9-148d-41e8-933c-6a38bb63f3e7 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:59.091124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 338/691] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Jul 28 11:04:58 2022] PUT /identity/v3/projects/11f4749185bf4adba9ae3cf927b6880b/users/2bf7f66ba696444f8055a498e292a182/roles/f2a8452a65264f9ea10467160b1bd735 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:04:59.096798 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 354/692] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:04:58 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 11:04:59.121728 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4392f9-148d-41e8-933c-6a38bb63f3e7 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:59.212042 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:59.250636 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4392f9-148d-41e8-933c-6a38bb63f3e7 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:59.296420 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de8ac5-edba-4691-87b0-69fa7d85a596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:59.297496 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de8ac5-edba-4691-87b0-69fa7d85a596 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:59.298006 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de8ac5-edba-4691-87b0-69fa7d85a596 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:59.298485 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de8ac5-edba-4691-87b0-69fa7d85a596 None admin] PATH_INFO: `/v3/services/image` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:59.299399 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de8ac5-edba-4691-87b0-69fa7d85a596 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:59.301073 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de8ac5-edba-4691-87b0-69fa7d85a596 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:59.312161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-b3de8ac5-edba-4691-87b0-69fa7d85a596 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 11:04:59.312161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:59.312161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:04:59.312161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:04:59.312161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:04:59.312161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:04:59.312161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:04:59.312161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:04:59.312161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 11:04:59.312161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:59.312161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:04:59.312161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:59.312161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:04:59.312161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:04:59.312161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:04:59.312161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:04:59.312161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:04:59.313269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:04:59.313269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:04:59.313269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:04:59.313269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:04:59.313269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:04:59.313269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:04:59.313269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:04:59.313269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:04:59.313269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:04:59.313269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:04:59.313269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:04:59.313269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:04:59.313269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:04:59.313269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:04:59.313269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:04:59.313269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:04:59.314099 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:04:59.314099 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:04:59.314099 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:04:59.314099 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:04:59.314099 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:04:59.314099 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:04:59.314099 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:04:59.314099 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:04:59.314099 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:04:59.314099 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:04:59.314099 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:04:59.314099 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:04:59.314099 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 11:04:59.314099 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:04:59.317171 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 339/693] 10.222.0.71 () {56 vars in 1105 bytes} [Thu Jul 28 11:04:59 2022] GET /identity/v3/services/image => generated 86 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:04:59.324303 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c439b-a9b8-414e-a801-ecf3c233fe52 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:59.450169 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c439b-a9b8-414e-a801-ecf3c233fe52 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:59.472064 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:59.493370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcdc24-4c40-4bdb-8069-04bb2122b036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:59.494022 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcdc24-4c40-4bdb-8069-04bb2122b036 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:59.494309 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcdc24-4c40-4bdb-8069-04bb2122b036 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:59.494591 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcdc24-4c40-4bdb-8069-04bb2122b036 None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:59.495348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcdc24-4c40-4bdb-8069-04bb2122b036 None admin] RBAC: Adding query filter params (name=image) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:59.495667 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcdc24-4c40-4bdb-8069-04bb2122b036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:59.497084 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcdc24-4c40-4bdb-8069-04bb2122b036 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:59.503034 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 355/694] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:04:59.509097 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de8ac5-edba-4691-87b0-69fa7d85a596 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:59.631557 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de8ac5-edba-4691-87b0-69fa7d85a596 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:59.671857 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d3b88-81eb-4b0e-9c49-4c145c784f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:59.672825 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d3b88-81eb-4b0e-9c49-4c145c784f6e None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:59.673313 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d3b88-81eb-4b0e-9c49-4c145c784f6e None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:59.673739 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d3b88-81eb-4b0e-9c49-4c145c784f6e None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:59.674581 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d3b88-81eb-4b0e-9c49-4c145c784f6e None admin] RBAC: Adding query filter params (type=image) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:59.675047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d3b88-81eb-4b0e-9c49-4c145c784f6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:59.676659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d3b88-81eb-4b0e-9c49-4c145c784f6e None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:59.678627 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:04:59.686771 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 340/695] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:04:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:59.692706 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcdc24-4c40-4bdb-8069-04bb2122b036 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:04:59.865223 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcdc24-4c40-4bdb-8069-04bb2122b036 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:04:59.916103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d4518-f759-4d0c-8ad8-cfe5d6bb8651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:04:59.917122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d4518-f759-4d0c-8ad8-cfe5d6bb8651 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:04:59.917568 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d4518-f759-4d0c-8ad8-cfe5d6bb8651 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:04:59.918003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d4518-f759-4d0c-8ad8-cfe5d6bb8651 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:04:59.918961 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d4518-f759-4d0c-8ad8-cfe5d6bb8651 None admin] RBAC: Adding query filter params (interface=public, service_id=b712220ecdd24cc48b8c89e16ae3152e, region_id=RegionOne) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:04:59.919482 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d4518-f759-4d0c-8ad8-cfe5d6bb8651 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:04:59.921157 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d4518-f759-4d0c-8ad8-cfe5d6bb8651 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:04:59.931300 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 356/696] 10.222.0.71 () {56 vars in 1251 bytes} [Thu Jul 28 11:04:59 2022] GET /identity/v3/endpoints?service_id=b712220ecdd24cc48b8c89e16ae3152e&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:04:59.936713 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d3b88-81eb-4b0e-9c49-4c145c784f6e None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:00.067795 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d3b88-81eb-4b0e-9c49-4c145c784f6e None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:00.101653 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a88322-7184-4597-8080-4a86943b9152 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:00.102331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a88322-7184-4597-8080-4a86943b9152 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:00.102822 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a88322-7184-4597-8080-4a86943b9152 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:00.104726 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 357/697] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:05:00.110692 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b2be1-102d-4d96-a928-fe04ae342823 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:00.111330 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b2be1-102d-4d96-a928-fe04ae342823 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:00.111982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b2be1-102d-4d96-a928-fe04ae342823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:00.122739 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8779b2-c797-4be2-b26c-02a2e5e5110c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:00.123852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8779b2-c797-4be2-b26c-02a2e5e5110c None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:00.124428 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8779b2-c797-4be2-b26c-02a2e5e5110c None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:00.124934 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8779b2-c797-4be2-b26c-02a2e5e5110c None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:00.126173 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8779b2-c797-4be2-b26c-02a2e5e5110c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:00.128767 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8779b2-c797-4be2-b26c-02a2e5e5110c None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:00.134716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-863b2be1-102d-4d96-a928-fe04ae342823 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:00.136299 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-863b2be1-102d-4d96-a928-fe04ae342823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:00.140809 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 341/698] 10.222.0.71 () {56 vars in 1087 bytes} [Thu Jul 28 11:04:59 2022] GET /identity/v3/services => generated 1002 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 11:05:00.192094 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:00.228978 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 358/699] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:00 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 11:05:00.254520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8779b2-c797-4be2-b26c-02a2e5e5110c None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:00.346731 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:00.397890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8779b2-c797-4be2-b26c-02a2e5e5110c None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:00.408546 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecffb6-4658-459f-b17e-423e84b6a596 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:00.409066 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecffb6-4658-459f-b17e-423e84b6a596 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:00.409509 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecffb6-4658-459f-b17e-423e84b6a596 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:00.412263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 359/700] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:05:00.420990 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2acff-d22c-4ebb-a22e-153cbc1009c8 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:00.421442 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2acff-d22c-4ebb-a22e-153cbc1009c8 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:00.421777 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2acff-d22c-4ebb-a22e-153cbc1009c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:00.444294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4623114-4723-4464-a9c2-6d5002b08631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:00.444927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4623114-4723-4464-a9c2-6d5002b08631 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:00.445213 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4623114-4723-4464-a9c2-6d5002b08631 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:00.445489 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4623114-4723-4464-a9c2-6d5002b08631 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:00.446795 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4623114-4723-4464-a9c2-6d5002b08631 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:00.448314 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4623114-4723-4464-a9c2-6d5002b08631 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:00.456133 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-41b2acff-d22c-4ebb-a22e-153cbc1009c8 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:00.458497 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-41b2acff-d22c-4ebb-a22e-153cbc1009c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:00.468741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-b4623114-4723-4464-a9c2-6d5002b08631 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 11:05:00.468741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:00.468741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:05:00.468741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:05:00.468741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:05:00.468741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:05:00.468741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:05:00.468741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:00.468741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 11:05:00.468741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:00.468741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:05:00.468741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:00.468741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:00.468741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:00.468741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:00.468741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:00.470520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:00.470520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:00.470520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:00.470520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:00.470520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:00.470520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:00.470520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:00.470520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:05:00.470520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:05:00.470520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:05:00.470520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:05:00.470520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:00.470520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:00.470520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:00.470520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:00.470520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:00.472710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:00.472710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:00.472710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:00.472710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:00.472710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:00.472710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:00.472710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:00.472710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:00.472710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:00.472710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:00.472710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:00.472710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:05:00.472710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:00.472710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 11:05:00.472710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:00.472710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 342/701] 10.222.0.71 () {56 vars in 1129 bytes} [Thu Jul 28 11:05:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:05:00.488851 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4623114-4723-4464-a9c2-6d5002b08631 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:00.582077 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 360/702] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:00 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 11:05:00.616874 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2acff-d22c-4ebb-a22e-153cbc1009c8 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:00.668227 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4623114-4723-4464-a9c2-6d5002b08631 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:00.704768 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:00.717704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb240b-be97-4457-bfd3-0dcfed52fc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:00.718430 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb240b-be97-4457-bfd3-0dcfed52fc69 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:00.718823 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb240b-be97-4457-bfd3-0dcfed52fc69 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:00.719169 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb240b-be97-4457-bfd3-0dcfed52fc69 None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:00.720311 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb240b-be97-4457-bfd3-0dcfed52fc69 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:00.720311 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb240b-be97-4457-bfd3-0dcfed52fc69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:00.721753 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb240b-be97-4457-bfd3-0dcfed52fc69 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:00.728002 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 343/703] 10.222.0.71 () {56 vars in 1124 bytes} [Thu Jul 28 11:05:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:00.733133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb240b-be97-4457-bfd3-0dcfed52fc69 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:00.758618 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2acff-d22c-4ebb-a22e-153cbc1009c8 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:00.769517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:00.805732 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edc41d-fc5d-486a-bf4f-a0541417d285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:00.806813 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edc41d-fc5d-486a-bf4f-a0541417d285 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:00.807107 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edc41d-fc5d-486a-bf4f-a0541417d285 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:00.807426 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edc41d-fc5d-486a-bf4f-a0541417d285 None admin] PATH_INFO: `/v3/services/network` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:00.808379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edc41d-fc5d-486a-bf4f-a0541417d285 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:00.809999 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edc41d-fc5d-486a-bf4f-a0541417d285 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:00.822272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-78edc41d-fc5d-486a-bf4f-a0541417d285 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 11:05:00.822272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:00.822272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:05:00.822272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:05:00.822272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:05:00.822272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:05:00.822272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:05:00.822272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:00.822272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 11:05:00.822272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:00.822272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:05:00.822272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:00.822272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:00.822272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:00.822272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:00.822272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:00.822272 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:00.823907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:00.823907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:00.823907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:00.823907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:00.823907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:00.823907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:00.823907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:05:00.823907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:05:00.823907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:05:00.823907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:05:00.823907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:00.823907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:00.823907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:00.823907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:00.823907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:00.823907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:00.824763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:00.824763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:00.824763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:00.824763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:00.824763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:00.824763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:00.824763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:00.824763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:00.824763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:00.824763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:00.824763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:05:00.824763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:00.824763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 11:05:00.824763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:00.824763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 361/704] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:05:00 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:05:00.830387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edc41d-fc5d-486a-bf4f-a0541417d285 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:00.870060 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb240b-be97-4457-bfd3-0dcfed52fc69 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:00.923358 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4130629-9540-4c48-bb66-31dd93599446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:00.924347 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4130629-9540-4c48-bb66-31dd93599446 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:00.924946 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4130629-9540-4c48-bb66-31dd93599446 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:00.925415 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4130629-9540-4c48-bb66-31dd93599446 None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:00.926388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4130629-9540-4c48-bb66-31dd93599446 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:00.926879 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4130629-9540-4c48-bb66-31dd93599446 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:00.928583 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4130629-9540-4c48-bb66-31dd93599446 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:00.939474 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 344/705] 10.222.0.71 () {56 vars in 1124 bytes} [Thu Jul 28 11:05:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:05:00.940967 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4130629-9540-4c48-bb66-31dd93599446 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:00.966587 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edc41d-fc5d-486a-bf4f-a0541417d285 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:01.016277 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccdc1a-077a-4dc8-bfec-a75832709646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:01.018422 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccdc1a-077a-4dc8-bfec-a75832709646 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:01.019257 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccdc1a-077a-4dc8-bfec-a75832709646 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:01.019988 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccdc1a-077a-4dc8-bfec-a75832709646 None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:01.021568 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccdc1a-077a-4dc8-bfec-a75832709646 None admin] RBAC: Adding query filter params (name=network) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:01.024039 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccdc1a-077a-4dc8-bfec-a75832709646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:01.027497 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccdc1a-077a-4dc8-bfec-a75832709646 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:01.027796 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:01.039051 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 362/706] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Jul 28 11:05:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:05:01.048105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccdc1a-077a-4dc8-bfec-a75832709646 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:01.107585 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:01.118258 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4130629-9540-4c48-bb66-31dd93599446 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:01.173019 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e30c86-9e26-4578-8e5c-b460b79bfd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:01.174114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e30c86-9e26-4578-8e5c-b460b79bfd77 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:01.174606 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e30c86-9e26-4578-8e5c-b460b79bfd77 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:01.175087 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e30c86-9e26-4578-8e5c-b460b79bfd77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:01.176147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e30c86-9e26-4578-8e5c-b460b79bfd77 None admin] RBAC: Adding query filter params (interface=public, service_id=bb5cf199fd2141ee88ae72732c8ecc42, region_id=RegionOne) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:01.176765 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e30c86-9e26-4578-8e5c-b460b79bfd77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:01.178435 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e30c86-9e26-4578-8e5c-b460b79bfd77 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:01.192979 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 345/707] 10.222.0.71 () {56 vars in 1251 bytes} [Thu Jul 28 11:05:00 2022] GET /identity/v3/endpoints?service_id=bb5cf199fd2141ee88ae72732c8ecc42&interface=public®ion_id=RegionOne => generated 194 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:01.193774 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccdc1a-077a-4dc8-bfec-a75832709646 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:01.195134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e30c86-9e26-4578-8e5c-b460b79bfd77 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:01.237384 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245d341-1329-4356-be28-cdb095f23066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:01.237947 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245d341-1329-4356-be28-cdb095f23066 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:01.238232 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245d341-1329-4356-be28-cdb095f23066 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:01.238517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245d341-1329-4356-be28-cdb095f23066 None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:01.239218 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245d341-1329-4356-be28-cdb095f23066 None admin] RBAC: Adding query filter params (type=network) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:01.239589 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245d341-1329-4356-be28-cdb095f23066 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:01.241011 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245d341-1329-4356-be28-cdb095f23066 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:01.253893 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 363/708] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Jul 28 11:05:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:01.254915 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245d341-1329-4356-be28-cdb095f23066 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:01.347250 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e30c86-9e26-4578-8e5c-b460b79bfd77 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:01.377842 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:01.391306 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245d341-1329-4356-be28-cdb095f23066 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:01.391586 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:01.419596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416a558-cb7a-4d66-abb9-32e0478d96cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:01.420890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416a558-cb7a-4d66-abb9-32e0478d96cc None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:01.421486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416a558-cb7a-4d66-abb9-32e0478d96cc None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:01.422074 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416a558-cb7a-4d66-abb9-32e0478d96cc None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:01.423507 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416a558-cb7a-4d66-abb9-32e0478d96cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:01.425857 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416a558-cb7a-4d66-abb9-32e0478d96cc None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:01.431238 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76873570-2621-47bd-b470-a6786216f078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:01.431924 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873570-2621-47bd-b470-a6786216f078 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:01.432205 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873570-2621-47bd-b470-a6786216f078 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:01.432485 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873570-2621-47bd-b470-a6786216f078 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:01.433273 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76873570-2621-47bd-b470-a6786216f078 None admin] RBAC: Adding query filter params (interface=public, service_id=599f4f67a91e4054a9a296141d5ac4ef, region_id=RegionOne) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:01.433588 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76873570-2621-47bd-b470-a6786216f078 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:01.435011 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76873570-2621-47bd-b470-a6786216f078 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:01.437070 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 346/709] 10.222.0.71 () {56 vars in 1087 bytes} [Thu Jul 28 11:05:01 2022] GET /identity/v3/services => generated 1002 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 11:05:01.441788 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 364/710] 10.222.0.71 () {56 vars in 1251 bytes} [Thu Jul 28 11:05:01 2022] GET /identity/v3/endpoints?service_id=599f4f67a91e4054a9a296141d5ac4ef&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:01.448663 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416a558-cb7a-4d66-abb9-32e0478d96cc None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:01.616112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416a558-cb7a-4d66-abb9-32e0478d96cc None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:01.647392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295767c4-256e-4485-8eeb-839ec78ac3d2 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:01.648720 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295767c4-256e-4485-8eeb-839ec78ac3d2 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:01.650008 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295767c4-256e-4485-8eeb-839ec78ac3d2 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:01.656556 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 365/711] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:05:01.658322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b13855-f0bc-4a50-8f13-260ea21c2873 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:01.658859 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b13855-f0bc-4a50-8f13-260ea21c2873 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:01.659421 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b13855-f0bc-4a50-8f13-260ea21c2873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:01.676094 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b42e5e-9b6e-47f4-9a74-3062ea25a9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:01.676962 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b42e5e-9b6e-47f4-9a74-3062ea25a9a5 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:01.677244 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b42e5e-9b6e-47f4-9a74-3062ea25a9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:01.677517 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b42e5e-9b6e-47f4-9a74-3062ea25a9a5 None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:01.678236 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b42e5e-9b6e-47f4-9a74-3062ea25a9a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:01.679896 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b42e5e-9b6e-47f4-9a74-3062ea25a9a5 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:01.682083 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-66b13855-f0bc-4a50-8f13-260ea21c2873 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:01.683643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-66b13855-f0bc-4a50-8f13-260ea21c2873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:01.687981 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 347/712] 10.222.0.71 () {56 vars in 1087 bytes} [Thu Jul 28 11:05:01 2022] GET /identity/v3/services => generated 1002 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 11:05:01.796482 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 366/713] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:01 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:05:01.835370 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b42e5e-9b6e-47f4-9a74-3062ea25a9a5 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:01.936269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:02.023806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b42e5e-9b6e-47f4-9a74-3062ea25a9a5 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:02.067107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd14a9a-6fe0-492c-abd3-19ccc7743d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:02.067849 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd14a9a-6fe0-492c-abd3-19ccc7743d12 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:02.068133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd14a9a-6fe0-492c-abd3-19ccc7743d12 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:02.068411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd14a9a-6fe0-492c-abd3-19ccc7743d12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:02.081675 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd14a9a-6fe0-492c-abd3-19ccc7743d12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:05:02.088014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-0dd14a9a-6fe0-492c-abd3-19ccc7743d12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:05:02.088014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:02.088014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:02.088014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:02.088014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:02.088014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:02.088014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:02.088014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:02.088014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:02.088014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:02.088014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:02.088014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:02.088014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:05:02.088014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:05:02.088014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:05:02.088014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:05:02.089316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:05:02.089316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:05:02.089316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:05:02.089316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:05:02.089316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:02.089316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:02.089316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:02.089316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:02.089316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:02.089316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:02.089316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:02.089316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:02.089316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:02.089316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:02.089316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:02.089316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:02.090362 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:02.090362 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:02.090362 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:02.090362 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:02.090362 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:05:02.090362 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:05:02.090362 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:05:02.090362 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:05:02.090362 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:05:02.090362 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:05:02.090362 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:05:02.090362 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:02.090362 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 348/714] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Jul 28 11:05:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:05:02.097934 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b13855-f0bc-4a50-8f13-260ea21c2873 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:02.213311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:02.222612 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b13855-f0bc-4a50-8f13-260ea21c2873 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:02.260655 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59391f3b-e544-481b-889d-43abcd0c1da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:02.261291 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59391f3b-e544-481b-889d-43abcd0c1da7 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:02.261835 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59391f3b-e544-481b-889d-43abcd0c1da7 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:02.262115 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59391f3b-e544-481b-889d-43abcd0c1da7 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:02.262855 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59391f3b-e544-481b-889d-43abcd0c1da7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:02.263163 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59391f3b-e544-481b-889d-43abcd0c1da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:02.264629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59391f3b-e544-481b-889d-43abcd0c1da7 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:02.281531 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 367/715] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:05:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:02.290299 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd14a9a-6fe0-492c-abd3-19ccc7743d12 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:02.418972 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd14a9a-6fe0-492c-abd3-19ccc7743d12 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:02.427208 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:02.458675 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a4f49-2496-4eb2-b9b9-28d3546e9675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:02.459430 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a4f49-2496-4eb2-b9b9-28d3546e9675 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:02.459720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a4f49-2496-4eb2-b9b9-28d3546e9675 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:02.460004 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a4f49-2496-4eb2-b9b9-28d3546e9675 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:02.472310 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a4f49-2496-4eb2-b9b9-28d3546e9675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:02.473719 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a4f49-2496-4eb2-b9b9-28d3546e9675 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:02.488893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-e14a4f49-2496-4eb2-b9b9-28d3546e9675 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:05:02.488893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:02.488893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:02.488893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:02.488893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:02.488893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:02.488893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:02.488893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:02.488893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:02.488893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:02.488893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:02.488893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:02.488893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:05:02.488893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:05:02.488893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:05:02.489861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:05:02.489861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:02.489861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:02.489861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:02.489861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:02.489861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:02.489861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:02.489861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:02.489861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:02.489861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:02.489861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:02.489861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:02.489861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:02.489861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:02.489861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:02.489861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:02.489861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:02.490726 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:05:02.490726 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:05:02.490726 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:05:02.490726 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:02.490726 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 349/716] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:05:02.497647 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59391f3b-e544-481b-889d-43abcd0c1da7 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:02.619374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59391f3b-e544-481b-889d-43abcd0c1da7 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:02.671113 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6194e36-1178-4f7f-9c7b-aa259d9abb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:02.671982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194e36-1178-4f7f-9c7b-aa259d9abb6f None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:02.672161 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194e36-1178-4f7f-9c7b-aa259d9abb6f None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:02.672398 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194e36-1178-4f7f-9c7b-aa259d9abb6f None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:02.673090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6194e36-1178-4f7f-9c7b-aa259d9abb6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:02.673392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6194e36-1178-4f7f-9c7b-aa259d9abb6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:02.674786 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6194e36-1178-4f7f-9c7b-aa259d9abb6f None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:02.689037 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 368/717] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:02.695337 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a4f49-2496-4eb2-b9b9-28d3546e9675 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:02.812180 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a4f49-2496-4eb2-b9b9-28d3546e9675 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:02.854273 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce50f80-a2b5-43a2-a556-2f94d4ba83d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:02.855325 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce50f80-a2b5-43a2-a556-2f94d4ba83d8 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:02.855832 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce50f80-a2b5-43a2-a556-2f94d4ba83d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:02.856326 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce50f80-a2b5-43a2-a556-2f94d4ba83d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:02.865374 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce50f80-a2b5-43a2-a556-2f94d4ba83d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:02.867781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce50f80-a2b5-43a2-a556-2f94d4ba83d8 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:02.880925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-8ce50f80-a2b5-43a2-a556-2f94d4ba83d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 11:05:02.880925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:02.880925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:02.880925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:02.880925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:02.880925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:02.880925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:02.880925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:02.880925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:02.880925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:02.880925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:02.880925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:02.880925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:05:02.880925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:05:02.880925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:05:02.880925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:05:02.882464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:02.882464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:02.882464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:05:02.882464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:05:02.882464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:05:02.882464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:05:02.882464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:02.882464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:02.882464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:02.882464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:02.882464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:02.882464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:02.882464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:02.882464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:02.882464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:02.882464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:02.882464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:02.882464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:02.884163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:02.884163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:02.884163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:05:02.884163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:05:02.884163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:05:02.884163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:05:02.884163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:05:02.884163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:05:02.884163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 11:05:02.884163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:02.884163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 350/718] 10.222.0.71 () {56 vars in 1093 bytes} [Thu Jul 28 11:05:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:05:02.891227 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6194e36-1178-4f7f-9c7b-aa259d9abb6f None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:02.912373 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:02.940649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc373692-d557-4834-beb6-c931a4c94bb8 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:02.941011 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc373692-d557-4834-beb6-c931a4c94bb8 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:02.941245 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc373692-d557-4834-beb6-c931a4c94bb8 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:02.942897 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 351/719] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:05:02.948768 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c03aa-cd9e-4562-97db-246de5d4fd59 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:02.949070 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c03aa-cd9e-4562-97db-246de5d4fd59 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:02.949331 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c03aa-cd9e-4562-97db-246de5d4fd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:02.969429 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-fe3c03aa-cd9e-4562-97db-246de5d4fd59 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:02.970806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-fe3c03aa-cd9e-4562-97db-246de5d4fd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:02.991489 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:03.050764 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6194e36-1178-4f7f-9c7b-aa259d9abb6f None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:03.067483 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 352/720] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:02 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:05:03.095426 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c03aa-cd9e-4562-97db-246de5d4fd59 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:03.104124 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb82a2d-a95f-4291-9d1c-65c2f8c77f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:03.104773 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb82a2d-a95f-4291-9d1c-65c2f8c77f16 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:03.105061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb82a2d-a95f-4291-9d1c-65c2f8c77f16 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:03.105345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb82a2d-a95f-4291-9d1c-65c2f8c77f16 None admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:03.106156 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb82a2d-a95f-4291-9d1c-65c2f8c77f16 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:03.106469 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb82a2d-a95f-4291-9d1c-65c2f8c77f16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:03.107976 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb82a2d-a95f-4291-9d1c-65c2f8c77f16 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:03.134263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 369/721] 10.222.0.71 () {56 vars in 1133 bytes} [Thu Jul 28 11:05:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:03.135485 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb82a2d-a95f-4291-9d1c-65c2f8c77f16 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:03.218209 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:03.218407 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c03aa-cd9e-4562-97db-246de5d4fd59 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:03.253877 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb82a2d-a95f-4291-9d1c-65c2f8c77f16 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:03.254079 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900529d3-8066-4290-be89-3286cac0f4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:03.254691 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900529d3-8066-4290-be89-3286cac0f4f9 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:03.254976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900529d3-8066-4290-be89-3286cac0f4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:03.255254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900529d3-8066-4290-be89-3286cac0f4f9 None admin] PATH_INFO: `/v3/services/image` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:03.255914 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900529d3-8066-4290-be89-3286cac0f4f9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:03.257861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900529d3-8066-4290-be89-3286cac0f4f9 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:03.267756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-900529d3-8066-4290-be89-3286cac0f4f9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 11:05:03.267756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:03.267756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:05:03.267756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:05:03.267756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:05:03.267756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:05:03.267756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:05:03.267756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:03.267756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 11:05:03.267756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:03.267756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:05:03.267756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:03.267756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:03.267756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:03.267756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:03.267756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:03.267756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:03.268761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:03.268761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:03.268761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:03.268761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:03.268761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:03.268761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:03.268761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:05:03.268761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:05:03.268761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:05:03.268761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:05:03.268761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:03.268761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:03.268761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:03.268761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:03.268761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:03.268761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:03.269576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:03.269576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:03.269576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:03.269576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:03.269576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:03.269576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:03.269576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:03.269576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:03.269576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:03.269576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:03.269576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:05:03.269576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:03.269576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 11:05:03.269576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:03.269576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 353/722] 10.222.0.71 () {56 vars in 1105 bytes} [Thu Jul 28 11:05:03 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:05:03.275176 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900529d3-8066-4290-be89-3286cac0f4f9 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:03.297677 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:03.310497 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5ed6e-566f-43d0-8132-fd14b677bc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:03.311194 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5ed6e-566f-43d0-8132-fd14b677bc12 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:03.311519 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5ed6e-566f-43d0-8132-fd14b677bc12 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:03.311858 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5ed6e-566f-43d0-8132-fd14b677bc12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:03.403837 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5ed6e-566f-43d0-8132-fd14b677bc12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:03.405742 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5ed6e-566f-43d0-8132-fd14b677bc12 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:03.413866 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900529d3-8066-4290-be89-3286cac0f4f9 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:03.451970 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c07c5-ecff-4854-a73a-47d3a61a9489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:03.452653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c07c5-ecff-4854-a73a-47d3a61a9489 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:03.452939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c07c5-ecff-4854-a73a-47d3a61a9489 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:03.453272 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c07c5-ecff-4854-a73a-47d3a61a9489 None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:03.454012 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c07c5-ecff-4854-a73a-47d3a61a9489 None admin] RBAC: Adding query filter params (name=image) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:03.454335 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c07c5-ecff-4854-a73a-47d3a61a9489 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:03.456339 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c07c5-ecff-4854-a73a-47d3a61a9489 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:03.463311 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 354/723] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:05:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:03.468488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c07c5-ecff-4854-a73a-47d3a61a9489 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:03.492420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:03.533908 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 370/724] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:05:03 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 11:05:03.535154 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5ed6e-566f-43d0-8132-fd14b677bc12 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:03.553111 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:03.578676 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c07c5-ecff-4854-a73a-47d3a61a9489 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:03.617336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e801fc3-a720-4962-9549-cfe8c83ad738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:03.618192 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e801fc3-a720-4962-9549-cfe8c83ad738 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:03.618533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e801fc3-a720-4962-9549-cfe8c83ad738 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:03.618909 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e801fc3-a720-4962-9549-cfe8c83ad738 None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:03.620212 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e801fc3-a720-4962-9549-cfe8c83ad738 None admin] RBAC: Adding query filter params (type=image) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:03.620212 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e801fc3-a720-4962-9549-cfe8c83ad738 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:03.621620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e801fc3-a720-4962-9549-cfe8c83ad738 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:03.633207 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 355/725] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:05:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:03.634250 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e801fc3-a720-4962-9549-cfe8c83ad738 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:03.666149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5ed6e-566f-43d0-8132-fd14b677bc12 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:03.722800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affe444-c89c-425b-8a5b-aa59f199f47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:03.724119 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affe444-c89c-425b-8a5b-aa59f199f47f None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:03.724300 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affe444-c89c-425b-8a5b-aa59f199f47f None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:03.724566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affe444-c89c-425b-8a5b-aa59f199f47f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:03.739965 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affe444-c89c-425b-8a5b-aa59f199f47f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:03.741515 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affe444-c89c-425b-8a5b-aa59f199f47f None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:03.767164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-2affe444-c89c-425b-8a5b-aa59f199f47f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:05:03.767164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:03.767164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:03.767164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:03.767164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:03.767164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:03.767164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:03.767164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:03.767164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:03.767164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:03.767164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:03.767164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:03.767164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:05:03.767164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:05:03.767164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:05:03.768162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:05:03.768162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:03.768162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:03.768162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:03.768162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:03.768162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:03.768162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:03.768162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:03.768162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:03.768162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:03.768162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:03.768162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:03.768162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:03.768162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:03.768162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:03.768162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:03.768162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:03.769071 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:05:03.769071 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:05:03.769071 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:05:03.769071 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:03.775004 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e801fc3-a720-4962-9549-cfe8c83ad738 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:03.775696 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 371/726] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:05:03.779397 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affe444-c89c-425b-8a5b-aa59f199f47f None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:03.821514 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f26427-83fe-45e1-86b7-c05722716c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:03.822645 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f26427-83fe-45e1-86b7-c05722716c5b None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:03.823176 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f26427-83fe-45e1-86b7-c05722716c5b None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:03.823685 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f26427-83fe-45e1-86b7-c05722716c5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:03.824715 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f26427-83fe-45e1-86b7-c05722716c5b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:03.827078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f26427-83fe-45e1-86b7-c05722716c5b None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:03.836935 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:03.844967 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:03.867317 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 356/727] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Jul 28 11:05:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 11:05:03.939397 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affe444-c89c-425b-8a5b-aa59f199f47f None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:03.965812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d347f-b21a-43ac-bfdb-484b71daf63b None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:03.966152 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d347f-b21a-43ac-bfdb-484b71daf63b None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:03.966366 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d347f-b21a-43ac-bfdb-484b71daf63b None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:03.969015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 357/728] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:05:03.976162 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac570fb4-2f24-4b31-9942-ef5baf0a489a None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:03.976621 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac570fb4-2f24-4b31-9942-ef5baf0a489a None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:03.977208 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac570fb4-2f24-4b31-9942-ef5baf0a489a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:03.992075 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6a457-a241-4f9b-9df5-79a7606e6a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:03.992976 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6a457-a241-4f9b-9df5-79a7606e6a66 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:03.993430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6a457-a241-4f9b-9df5-79a7606e6a66 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:03.993844 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6a457-a241-4f9b-9df5-79a7606e6a66 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:03.994710 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6a457-a241-4f9b-9df5-79a7606e6a66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:03.995172 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6a457-a241-4f9b-9df5-79a7606e6a66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:03.996774 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6a457-a241-4f9b-9df5-79a7606e6a66 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:04.000406 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-ac570fb4-2f24-4b31-9942-ef5baf0a489a None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:04.002052 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-ac570fb4-2f24-4b31-9942-ef5baf0a489a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:04.013235 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 372/729] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:05:04.018869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6a457-a241-4f9b-9df5-79a7606e6a66 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:04.103712 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 358/730] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:03 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:05:04.126021 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac570fb4-2f24-4b31-9942-ef5baf0a489a None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:04.129639 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:04.160317 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6a457-a241-4f9b-9df5-79a7606e6a66 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:04.206305 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae4e8f-723d-4475-9695-98157e6816da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:04.206876 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae4e8f-723d-4475-9695-98157e6816da None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:04.207160 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae4e8f-723d-4475-9695-98157e6816da None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:04.207471 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae4e8f-723d-4475-9695-98157e6816da None admin] PATH_INFO: `/v3/projects/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:04.215131 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae4e8f-723d-4475-9695-98157e6816da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:04.216614 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae4e8f-723d-4475-9695-98157e6816da None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:04.229458 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-4bae4e8f-723d-4475-9695-98157e6816da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:05:04.229458 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:04.229458 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:04.229458 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:04.229458 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:04.229458 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:04.229458 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:04.229458 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:04.229458 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:04.229458 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:04.229458 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:04.229458 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:04.229458 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:05:04.229458 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:05:04.229458 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:05:04.230494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:05:04.230494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:04.230494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:04.230494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:04.230494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:04.230494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:04.230494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:04.230494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:04.230494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:04.230494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:04.230494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:04.230494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:04.230494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:04.230494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:04.230494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:04.230494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:04.230494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:04.231496 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:05:04.231496 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:05:04.231496 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:05:04.231496 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:05:04.231496 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:05:04.231496 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:05:04.231496 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:05:04.231496 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:04.231496 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 373/731] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:05:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:05:04.231976 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe0568-3a2b-456a-96f6-dd43c691eee3 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:04.232676 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe0568-3a2b-456a-96f6-dd43c691eee3 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:04.232776 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe0568-3a2b-456a-96f6-dd43c691eee3 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:04.237643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 374/732] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:05:04.238748 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe0568-3a2b-456a-96f6-dd43c691eee3 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:04.262124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac570fb4-2f24-4b31-9942-ef5baf0a489a None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:04.290073 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:04.300325 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1242c7-d3b9-43ca-b444-76c3255c17c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:04.300981 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1242c7-d3b9-43ca-b444-76c3255c17c6 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:04.301264 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1242c7-d3b9-43ca-b444-76c3255c17c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:04.301545 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1242c7-d3b9-43ca-b444-76c3255c17c6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:04.302177 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1242c7-d3b9-43ca-b444-76c3255c17c6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:04.303617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1242c7-d3b9-43ca-b444-76c3255c17c6 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:04.313659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-7e1242c7-d3b9-43ca-b444-76c3255c17c6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 11:05:04.313659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:04.313659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:05:04.313659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:05:04.313659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:05:04.313659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:05:04.313659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:05:04.313659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:04.313659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 11:05:04.313659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:04.313659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:05:04.313659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:04.313659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:04.313659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:04.313659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:04.313659 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:04.314785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:04.314785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:04.314785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:04.314785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:04.314785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:04.314785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:04.314785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:04.314785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:05:04.314785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:05:04.314785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:05:04.314785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:05:04.314785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:04.314785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:04.314785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:04.314785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:04.314785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:04.315876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:04.315876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:04.315876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:04.315876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:04.315876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:04.315876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:04.315876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:04.315876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:04.315876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:04.315876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:04.315876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:04.315876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:05:04.315876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:04.315876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 11:05:04.315876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:04.319830 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 359/733] 10.222.0.71 () {56 vars in 1129 bytes} [Thu Jul 28 11:05:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:05:04.321134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1ac40-0620-4c82-9196-0d7ba975c0b5 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:04.321420 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1ac40-0620-4c82-9196-0d7ba975c0b5 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:04.321704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1ac40-0620-4c82-9196-0d7ba975c0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:04.340811 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-00c1ac40-0620-4c82-9196-0d7ba975c0b5 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:04.342001 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-00c1ac40-0620-4c82-9196-0d7ba975c0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:04.365071 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe0568-3a2b-456a-96f6-dd43c691eee3 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:04.407378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68dbd9-ed22-4217-9789-a5e0320a2902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:04.408392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68dbd9-ed22-4217-9789-a5e0320a2902 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:04.408678 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68dbd9-ed22-4217-9789-a5e0320a2902 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:04.409040 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68dbd9-ed22-4217-9789-a5e0320a2902 None admin] PATH_INFO: `/v3/projects` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:04.409722 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68dbd9-ed22-4217-9789-a5e0320a2902 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:04.410054 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68dbd9-ed22-4217-9789-a5e0320a2902 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:04.411536 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68dbd9-ed22-4217-9789-a5e0320a2902 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:04.420814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:04.425034 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 360/734] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:04 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:05:04.431812 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 375/735] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:05:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:04.432623 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68dbd9-ed22-4217-9789-a5e0320a2902 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:04.433061 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1ac40-0620-4c82-9196-0d7ba975c0b5 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:04.555876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1ac40-0620-4c82-9196-0d7ba975c0b5 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:04.557054 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68dbd9-ed22-4217-9789-a5e0320a2902 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:04.581375 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:04.593854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de94be-bd6c-4546-becc-351704f848a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:04.594494 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de94be-bd6c-4546-becc-351704f848a1 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:04.594814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de94be-bd6c-4546-becc-351704f848a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:04.595065 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de94be-bd6c-4546-becc-351704f848a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:04.595893 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de94be-bd6c-4546-becc-351704f848a1 None admin] RBAC: Adding query filter params (role.id=f2a8452a65264f9ea10467160b1bd735, scope.project.id=11f4749185bf4adba9ae3cf927b6880b, user.id=2bf7f66ba696444f8055a498e292a182) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:04.596215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de94be-bd6c-4546-becc-351704f848a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:04.597978 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de94be-bd6c-4546-becc-351704f848a1 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:04.599448 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7815d6-35e8-4f07-9101-82a72301baf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:04.600076 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7815d6-35e8-4f07-9101-82a72301baf7 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:04.600358 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7815d6-35e8-4f07-9101-82a72301baf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:04.600630 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7815d6-35e8-4f07-9101-82a72301baf7 None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:04.601832 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7815d6-35e8-4f07-9101-82a72301baf7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:04.602124 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7815d6-35e8-4f07-9101-82a72301baf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:04.603537 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7815d6-35e8-4f07-9101-82a72301baf7 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:04.615182 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 376/736] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:05:04 2022] GET /identity/v3/role_assignments?user.id=2bf7f66ba696444f8055a498e292a182&scope.project.id=11f4749185bf4adba9ae3cf927b6880b&role.id=f2a8452a65264f9ea10467160b1bd735 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:04.615182 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de94be-bd6c-4546-becc-351704f848a1 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:04.623917 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 361/737] 10.222.0.71 () {56 vars in 1124 bytes} [Thu Jul 28 11:05:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:04.630411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7815d6-35e8-4f07-9101-82a72301baf7 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:04.701037 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:04.750380 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de94be-bd6c-4546-becc-351704f848a1 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:04.768625 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7815d6-35e8-4f07-9101-82a72301baf7 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:04.793400 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a42f8c-b8f3-47ad-a837-278fd9c898f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:04.794356 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42f8c-b8f3-47ad-a837-278fd9c898f6 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:04.794638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42f8c-b8f3-47ad-a837-278fd9c898f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:04.795060 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42f8c-b8f3-47ad-a837-278fd9c898f6 None admin] PATH_INFO: `/v3/services/network` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:04.795813 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a42f8c-b8f3-47ad-a837-278fd9c898f6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:04.797284 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a42f8c-b8f3-47ad-a837-278fd9c898f6 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:04.808121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-19a42f8c-b8f3-47ad-a837-278fd9c898f6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 11:05:04.808121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:04.808121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:05:04.808121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:05:04.808121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:05:04.808121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:05:04.808121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:05:04.808121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:04.808121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 11:05:04.808121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:04.808121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:05:04.808121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:04.808121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:04.808121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:04.808121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:04.808121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:04.808121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:04.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:04.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:04.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:04.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:04.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:04.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:04.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:05:04.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:05:04.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:05:04.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:05:04.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:04.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:04.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:04.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:04.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:04.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:04.810350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:04.810350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:04.810350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:04.810350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:04.810350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:04.810350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:04.810350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:04.810350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:04.810350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:04.810350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:04.810350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:05:04.810350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:04.810350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 11:05:04.810350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:04.811088 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 377/738] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:05:04 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:05:04.820836 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a42f8c-b8f3-47ad-a837-278fd9c898f6 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:04.826479 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b71ccf-5f3a-4c04-8dbf-ab59b58f137d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:04.827948 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b71ccf-5f3a-4c04-8dbf-ab59b58f137d None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:04.828495 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b71ccf-5f3a-4c04-8dbf-ab59b58f137d None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:04.829284 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b71ccf-5f3a-4c04-8dbf-ab59b58f137d None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:04.830104 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b71ccf-5f3a-4c04-8dbf-ab59b58f137d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:04.830433 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b71ccf-5f3a-4c04-8dbf-ab59b58f137d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:04.832817 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b71ccf-5f3a-4c04-8dbf-ab59b58f137d None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:04.843408 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 362/739] 10.222.0.71 () {56 vars in 1124 bytes} [Thu Jul 28 11:05:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:04.844889 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b71ccf-5f3a-4c04-8dbf-ab59b58f137d None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:04.911187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:04.968797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a42f8c-b8f3-47ad-a837-278fd9c898f6 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:04.988873 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b71ccf-5f3a-4c04-8dbf-ab59b58f137d None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:05.001798 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:05.012990 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae566789-a7e6-4742-8af4-8a3de299577e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:05.013689 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae566789-a7e6-4742-8af4-8a3de299577e None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:05.013982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae566789-a7e6-4742-8af4-8a3de299577e None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:05.014265 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae566789-a7e6-4742-8af4-8a3de299577e None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:05.015063 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae566789-a7e6-4742-8af4-8a3de299577e None admin] RBAC: Adding query filter params (name=network) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:05.015413 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae566789-a7e6-4742-8af4-8a3de299577e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:05.016806 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae566789-a7e6-4742-8af4-8a3de299577e None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:05.023170 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 378/740] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Jul 28 11:05:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:05.029128 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae566789-a7e6-4742-8af4-8a3de299577e None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:05.036103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5391b3-5202-4c4b-905a-c771d1dc55de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:05.036739 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5391b3-5202-4c4b-905a-c771d1dc55de None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:05.037025 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5391b3-5202-4c4b-905a-c771d1dc55de None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:05.037300 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5391b3-5202-4c4b-905a-c771d1dc55de None admin] PATH_INFO: `/v3/endpoints` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:05.038094 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5391b3-5202-4c4b-905a-c771d1dc55de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:05.040614 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5391b3-5202-4c4b-905a-c771d1dc55de None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:05.069238 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 363/741] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Jul 28 11:05:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 11:05:05.158671 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae566789-a7e6-4742-8af4-8a3de299577e None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:05.206253 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f33cc-a697-499f-bcd6-d349beefdc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:05.206905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f33cc-a697-499f-bcd6-d349beefdc34 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:05.207239 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f33cc-a697-499f-bcd6-d349beefdc34 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:05.207559 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f33cc-a697-499f-bcd6-d349beefdc34 None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:05.208265 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f33cc-a697-499f-bcd6-d349beefdc34 None admin] RBAC: Adding query filter params (type=network) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:05.208574 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f33cc-a697-499f-bcd6-d349beefdc34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:05.210563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f33cc-a697-499f-bcd6-d349beefdc34 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:05.217106 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 379/742] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Jul 28 11:05:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:05:05.222771 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5391b3-5202-4c4b-905a-c771d1dc55de None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:05.353627 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5391b3-5202-4c4b-905a-c771d1dc55de None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:05.356229 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:05.403639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e61c46-4ffb-4cc8-ab7b-0e505228af1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:05.404423 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e61c46-4ffb-4cc8-ab7b-0e505228af1e None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:05.404783 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e61c46-4ffb-4cc8-ab7b-0e505228af1e None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:05.405129 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e61c46-4ffb-4cc8-ab7b-0e505228af1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:05.405931 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e61c46-4ffb-4cc8-ab7b-0e505228af1e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:05.407411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e61c46-4ffb-4cc8-ab7b-0e505228af1e None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:05.432167 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 364/743] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Jul 28 11:05:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:05:06.266146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5066b-d003-4bd4-91dd-3f717d799489 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:06.266838 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5066b-d003-4bd4-91dd-3f717d799489 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:06.266838 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5066b-d003-4bd4-91dd-3f717d799489 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:06.268156 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 380/744] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:05:06.273302 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef3717-4ffb-4aa7-9197-cde896055b6c None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:06.273741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef3717-4ffb-4aa7-9197-cde896055b6c None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:06.273917 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef3717-4ffb-4aa7-9197-cde896055b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:06.293014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-07ef3717-4ffb-4aa7-9197-cde896055b6c None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:06.294225 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-07ef3717-4ffb-4aa7-9197-cde896055b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:06.381898 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 365/745] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:06 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:05:06.404927 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5066b-d003-4bd4-91dd-3f717d799489 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:06.473768 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:06.544864 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5066b-d003-4bd4-91dd-3f717d799489 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:06.584234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f56f3-d9cc-4830-ac71-8c1ed1b5e800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:06.584924 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f56f3-d9cc-4830-ac71-8c1ed1b5e800 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:06.585769 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f56f3-d9cc-4830-ac71-8c1ed1b5e800 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:06.586126 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f56f3-d9cc-4830-ac71-8c1ed1b5e800 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:06.660404 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f56f3-d9cc-4830-ac71-8c1ed1b5e800 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:06.661868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f56f3-d9cc-4830-ac71-8c1ed1b5e800 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:06.714742 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:06.765066 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 381/746] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:05:06 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 11:05:06.770548 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef3717-4ffb-4aa7-9197-cde896055b6c None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:06.864976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:06.886270 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef3717-4ffb-4aa7-9197-cde896055b6c None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:06.925212 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f4c25-ef20-487a-9019-98c91b0cdcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:06.925867 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f4c25-ef20-487a-9019-98c91b0cdcfa None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:06.926151 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f4c25-ef20-487a-9019-98c91b0cdcfa None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:06.926430 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f4c25-ef20-487a-9019-98c91b0cdcfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:06.937137 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f4c25-ef20-487a-9019-98c91b0cdcfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:06.938615 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f4c25-ef20-487a-9019-98c91b0cdcfa None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:06.955698 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-1c9f4c25-ef20-487a-9019-98c91b0cdcfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:05:06.955698 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:06.955698 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:06.955698 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:06.955698 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:06.955698 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:06.955698 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:06.955698 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:06.955698 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:06.955698 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:06.955698 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:06.955698 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:06.955698 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:05:06.955698 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:05:06.955698 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:05:06.956704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:05:06.956704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:06.956704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:06.956704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:06.956704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:06.956704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:06.956704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:06.956704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:06.956704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:06.956704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:06.956704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:06.956704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:06.956704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:06.956704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:06.956704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:06.956704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:06.956704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:06.957684 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:05:06.957684 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:05:06.957684 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:05:06.957684 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:06.957684 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 366/747] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:05:06.964635 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f56f3-d9cc-4830-ac71-8c1ed1b5e800 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:07.040532 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512e227-02d2-4f1b-97ae-011dac0d6f14 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:07.040936 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512e227-02d2-4f1b-97ae-011dac0d6f14 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:07.041167 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512e227-02d2-4f1b-97ae-011dac0d6f14 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:07.042521 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 367/748] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:05:07.048054 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdaa46-02b0-4a11-aedb-856cb8a4de8c None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:07.048339 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdaa46-02b0-4a11-aedb-856cb8a4de8c None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:07.048615 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdaa46-02b0-4a11-aedb-856cb8a4de8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:07.067178 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-18fdaa46-02b0-4a11-aedb-856cb8a4de8c None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:07.068306 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f56f3-d9cc-4830-ac71-8c1ed1b5e800 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:07.068434 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-18fdaa46-02b0-4a11-aedb-856cb8a4de8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:07.109309 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d618ae-2605-4cc9-9b3f-ef30fe73510d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:07.110306 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d618ae-2605-4cc9-9b3f-ef30fe73510d None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:07.110793 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d618ae-2605-4cc9-9b3f-ef30fe73510d None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:07.111308 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d618ae-2605-4cc9-9b3f-ef30fe73510d None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:07.112210 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d618ae-2605-4cc9-9b3f-ef30fe73510d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:07.112786 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d618ae-2605-4cc9-9b3f-ef30fe73510d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:07.114505 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d618ae-2605-4cc9-9b3f-ef30fe73510d None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:07.139386 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 382/749] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:05:07.142970 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 368/750] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:07 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 11:05:07.166790 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d618ae-2605-4cc9-9b3f-ef30fe73510d None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:07.184664 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:07.283758 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d618ae-2605-4cc9-9b3f-ef30fe73510d None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:07.333793 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b54d82-0a61-4d9d-b84d-c2640deeddd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:07.334508 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b54d82-0a61-4d9d-b84d-c2640deeddd9 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:07.334863 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b54d82-0a61-4d9d-b84d-c2640deeddd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:07.335244 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b54d82-0a61-4d9d-b84d-c2640deeddd9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:07.335939 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b54d82-0a61-4d9d-b84d-c2640deeddd9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:07.337392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b54d82-0a61-4d9d-b84d-c2640deeddd9 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:07.347785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-98b54d82-0a61-4d9d-b84d-c2640deeddd9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 11:05:07.347785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:07.347785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:05:07.347785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:05:07.347785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:05:07.347785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:05:07.347785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:05:07.347785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:07.347785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 11:05:07.347785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:07.347785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:05:07.347785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:07.347785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:07.347785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:07.347785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:07.347785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:07.348814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:07.348814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:07.348814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:07.348814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:07.348814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:07.348814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:07.348814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:07.348814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:05:07.348814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:05:07.348814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:05:07.348814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:05:07.348814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:07.348814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:07.348814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:07.348814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:07.348814 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:07.350033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:07.350033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:07.350033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:07.350033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:07.350033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:07.350033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:07.350033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:07.350033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:07.350033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:07.350033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:07.350033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:07.350033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:05:07.350033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:07.350033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 11:05:07.350033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:07.350033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 383/751] 10.222.0.71 () {56 vars in 1132 bytes} [Thu Jul 28 11:05:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:05:07.355766 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdaa46-02b0-4a11-aedb-856cb8a4de8c None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:07.432559 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:07.469562 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdaa46-02b0-4a11-aedb-856cb8a4de8c None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:07.494674 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1724b4-1375-4f00-b41f-1123e53338ae None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:07.495057 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1724b4-1375-4f00-b41f-1123e53338ae None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:07.495238 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1724b4-1375-4f00-b41f-1123e53338ae None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:07.496616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 384/752] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:05:07.501398 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff4b6d-4881-4699-abd9-a5f893b398d1 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:07.501690 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff4b6d-4881-4699-abd9-a5f893b398d1 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:07.501965 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff4b6d-4881-4699-abd9-a5f893b398d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:07.504417 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0fe51-7edd-45e8-9aa2-a81acfca01e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:07.505041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0fe51-7edd-45e8-9aa2-a81acfca01e9 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:07.505327 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0fe51-7edd-45e8-9aa2-a81acfca01e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:07.505609 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0fe51-7edd-45e8-9aa2-a81acfca01e9 None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:07.506295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0fe51-7edd-45e8-9aa2-a81acfca01e9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:07.506601 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0fe51-7edd-45e8-9aa2-a81acfca01e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:07.508048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0fe51-7edd-45e8-9aa2-a81acfca01e9 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:07.512948 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 369/753] 10.222.0.71 () {56 vars in 1126 bytes} [Thu Jul 28 11:05:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:07.518371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0fe51-7edd-45e8-9aa2-a81acfca01e9 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:07.520124 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-3fff4b6d-4881-4699-abd9-a5f893b398d1 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:07.521338 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-3fff4b6d-4881-4699-abd9-a5f893b398d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:07.590521 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 385/754] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:07 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 11:05:07.613877 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff4b6d-4881-4699-abd9-a5f893b398d1 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:07.621002 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0fe51-7edd-45e8-9aa2-a81acfca01e9 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:07.621865 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:07.655417 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:07.661574 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde461f0-a449-44c6-96f2-ed465974488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:07.662203 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde461f0-a449-44c6-96f2-ed465974488b None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:07.662484 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde461f0-a449-44c6-96f2-ed465974488b None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:07.662761 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde461f0-a449-44c6-96f2-ed465974488b None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:07.663826 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde461f0-a449-44c6-96f2-ed465974488b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:07.663826 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde461f0-a449-44c6-96f2-ed465974488b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:07.665176 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde461f0-a449-44c6-96f2-ed465974488b None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:07.669720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 370/755] 10.222.0.71 () {56 vars in 1126 bytes} [Thu Jul 28 11:05:07 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:05:07.722248 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff4b6d-4881-4699-abd9-a5f893b398d1 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:07.760091 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bf76a-97f0-47a8-b650-3772b8fe0115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:07.760765 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bf76a-97f0-47a8-b650-3772b8fe0115 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:07.761054 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bf76a-97f0-47a8-b650-3772b8fe0115 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:07.761370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bf76a-97f0-47a8-b650-3772b8fe0115 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:07.762289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bf76a-97f0-47a8-b650-3772b8fe0115 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:07.763751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bf76a-97f0-47a8-b650-3772b8fe0115 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:07.774102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-4d8bf76a-97f0-47a8-b650-3772b8fe0115 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 11:05:07.774102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:07.774102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:05:07.774102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:05:07.774102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:05:07.774102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:05:07.774102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:05:07.774102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:07.774102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 11:05:07.774102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:07.774102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:05:07.774102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:07.774102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:07.774102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:07.774102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:07.774102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:07.774102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:07.775387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:07.775387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:07.775387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:07.775387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:07.775387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:07.775387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:07.775387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:05:07.775387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:05:07.775387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:05:07.775387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:05:07.775387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:07.775387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:07.775387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:07.775387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:07.775387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:07.775387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:07.776228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:07.776228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:07.776228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:07.776228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:07.776228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:07.776228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:07.776228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:07.776228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:07.776228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:07.776228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:07.776228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:05:07.776228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:07.776228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 11:05:07.776228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:07.776228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 386/756] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:05:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:05:07.781530 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde461f0-a449-44c6-96f2-ed465974488b None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:07.911882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde461f0-a449-44c6-96f2-ed465974488b None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:07.946294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf652887-28d6-4ddb-9d3c-a03d5ae4d81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:07.946926 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf652887-28d6-4ddb-9d3c-a03d5ae4d81a None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:07.947206 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf652887-28d6-4ddb-9d3c-a03d5ae4d81a None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:07.947512 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf652887-28d6-4ddb-9d3c-a03d5ae4d81a None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:07.948187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf652887-28d6-4ddb-9d3c-a03d5ae4d81a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:07.948490 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf652887-28d6-4ddb-9d3c-a03d5ae4d81a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:07.949872 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf652887-28d6-4ddb-9d3c-a03d5ae4d81a None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:07.954674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 371/757] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:05:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:07.960333 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bf76a-97f0-47a8-b650-3772b8fe0115 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:08.033027 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:08.072289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bf76a-97f0-47a8-b650-3772b8fe0115 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:08.106536 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0de70-232f-4089-9f17-33e33de6f419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:08.107161 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0de70-232f-4089-9f17-33e33de6f419 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:08.107476 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0de70-232f-4089-9f17-33e33de6f419 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:08.107752 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0de70-232f-4089-9f17-33e33de6f419 None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:08.108426 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0de70-232f-4089-9f17-33e33de6f419 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:08.108733 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0de70-232f-4089-9f17-33e33de6f419 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:08.110094 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0de70-232f-4089-9f17-33e33de6f419 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:08.114581 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 387/758] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:05:07 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:09.926198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1257c-9ac4-47af-8a53-c9ad92ce0b69 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:09.926763 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1257c-9ac4-47af-8a53-c9ad92ce0b69 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:09.926763 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1257c-9ac4-47af-8a53-c9ad92ce0b69 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:09.928091 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 372/759] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:05:09.933351 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dc67e-aa95-4068-869e-f05c9dabf845 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:09.933799 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dc67e-aa95-4068-869e-f05c9dabf845 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:09.933893 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dc67e-aa95-4068-869e-f05c9dabf845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:09.952149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-6f2dc67e-aa95-4068-869e-f05c9dabf845 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:09.953326 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-6f2dc67e-aa95-4068-869e-f05c9dabf845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:10.021591 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 388/760] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:09 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:05:10.045771 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1257c-9ac4-47af-8a53-c9ad92ce0b69 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:10.106650 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:10.149631 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1257c-9ac4-47af-8a53-c9ad92ce0b69 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:10.183947 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5b835-e968-4061-8422-f4a7a905eccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:10.184489 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5b835-e968-4061-8422-f4a7a905eccc None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:10.184771 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5b835-e968-4061-8422-f4a7a905eccc None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:10.185046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5b835-e968-4061-8422-f4a7a905eccc None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:10.185729 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5b835-e968-4061-8422-f4a7a905eccc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:10.187167 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5b835-e968-4061-8422-f4a7a905eccc None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:10.202268 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 373/761] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Jul 28 11:05:10 2022] POST /identity/v3/services => generated 269 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:05:10.381639 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11f466-a344-4661-8913-f517255531ef None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:10.382038 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11f466-a344-4661-8913-f517255531ef None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:10.382928 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11f466-a344-4661-8913-f517255531ef None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:10.384330 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 389/762] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:05:10.390347 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac7787-d9c6-4e5f-a2d8-df1047f6a1ce None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:10.390630 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac7787-d9c6-4e5f-a2d8-df1047f6a1ce None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:10.390914 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac7787-d9c6-4e5f-a2d8-df1047f6a1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:10.410700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-0fac7787-d9c6-4e5f-a2d8-df1047f6a1ce None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:10.411952 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-0fac7787-d9c6-4e5f-a2d8-df1047f6a1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:10.486410 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 374/763] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:10 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:05:10.512139 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11f466-a344-4661-8913-f517255531ef None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:10.575900 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:10.614859 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11f466-a344-4661-8913-f517255531ef None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:10.652198 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29bfb5-b1c6-4d93-933d-03b6d6e197c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:10.652836 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29bfb5-b1c6-4d93-933d-03b6d6e197c8 None admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:10.653110 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29bfb5-b1c6-4d93-933d-03b6d6e197c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:10.653382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29bfb5-b1c6-4d93-933d-03b6d6e197c8 None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:10.654085 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29bfb5-b1c6-4d93-933d-03b6d6e197c8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:10.655519 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29bfb5-b1c6-4d93-933d-03b6d6e197c8 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:10.675471 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 390/764] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Jul 28 11:05:10 2022] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:05:12.479755 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bce54-3167-4694-a425-9d075f352213 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:12.480304 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bce54-3167-4694-a425-9d075f352213 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:12.480304 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bce54-3167-4694-a425-9d075f352213 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:12.481693 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 375/765] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:05:12.487383 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1790318-feeb-42ea-aa57-d741df3fc96a None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:12.487828 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1790318-feeb-42ea-aa57-d741df3fc96a None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:12.488059 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1790318-feeb-42ea-aa57-d741df3fc96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:12.506301 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-b1790318-feeb-42ea-aa57-d741df3fc96a None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:12.507595 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-b1790318-feeb-42ea-aa57-d741df3fc96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:12.587627 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 391/766] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:12 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:05:12.611998 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bce54-3167-4694-a425-9d075f352213 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:12.661532 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:12.716734 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bce54-3167-4694-a425-9d075f352213 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:12.751840 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374e9dd-7b8a-4d98-a9c9-8dfb01c973fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:12.752501 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374e9dd-7b8a-4d98-a9c9-8dfb01c973fb None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:12.752781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374e9dd-7b8a-4d98-a9c9-8dfb01c973fb None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:12.753058 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374e9dd-7b8a-4d98-a9c9-8dfb01c973fb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:12.753697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374e9dd-7b8a-4d98-a9c9-8dfb01c973fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:12.755984 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374e9dd-7b8a-4d98-a9c9-8dfb01c973fb None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:12.766639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-e374e9dd-7b8a-4d98-a9c9-8dfb01c973fb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 11:05:12.766639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:12.766639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:05:12.766639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:05:12.766639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:05:12.766639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:05:12.766639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:05:12.766639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:12.766639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 11:05:12.766639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:12.766639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:05:12.766639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:12.766639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:12.766639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:12.766639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:12.766639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:12.767794 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:12.767794 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:12.767794 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:12.767794 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:12.767794 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:12.767794 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:12.767794 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:12.767794 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:05:12.767794 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:05:12.767794 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:05:12.767794 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:05:12.767794 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:12.767794 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:12.767794 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:12.767794 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:12.767794 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:12.768623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:12.768623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:12.768623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:12.768623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:12.768623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:12.768623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:12.768623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:12.768623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:12.768623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:12.768623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:12.768623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:12.768623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:05:12.768623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:12.768623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 11:05:12.768623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:12.768623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 376/767] 10.222.0.71 () {56 vars in 1132 bytes} [Thu Jul 28 11:05:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:05:12.774810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1790318-feeb-42ea-aa57-d741df3fc96a None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:12.828082 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:12.878985 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1790318-feeb-42ea-aa57-d741df3fc96a None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:12.914435 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04320c16-0ec5-4c6b-8e92-32e3e26703fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:12.914981 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04320c16-0ec5-4c6b-8e92-32e3e26703fb None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:12.915283 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04320c16-0ec5-4c6b-8e92-32e3e26703fb None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:12.915575 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04320c16-0ec5-4c6b-8e92-32e3e26703fb None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:12.916259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04320c16-0ec5-4c6b-8e92-32e3e26703fb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:12.916571 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04320c16-0ec5-4c6b-8e92-32e3e26703fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:12.917948 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04320c16-0ec5-4c6b-8e92-32e3e26703fb None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:12.923241 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 392/768] 10.222.0.71 () {56 vars in 1126 bytes} [Thu Jul 28 11:05:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:12.928910 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374e9dd-7b8a-4d98-a9c9-8dfb01c973fb None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:12.930973 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79164844-e9c4-443c-bda0-cf71e9404dfb None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:12.931282 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79164844-e9c4-443c-bda0-cf71e9404dfb None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:12.931581 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79164844-e9c4-443c-bda0-cf71e9404dfb None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:12.932890 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 393/769] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:05:12.938133 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308c168-7e78-456d-9d48-6e06837fa478 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:12.938418 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308c168-7e78-456d-9d48-6e06837fa478 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:12.938694 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308c168-7e78-456d-9d48-6e06837fa478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:12.956999 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-1308c168-7e78-456d-9d48-6e06837fa478 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:12.958198 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-1308c168-7e78-456d-9d48-6e06837fa478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:13.028446 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 394/770] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:12 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 11:05:13.034238 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374e9dd-7b8a-4d98-a9c9-8dfb01c973fb None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:13.045094 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:13.052218 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308c168-7e78-456d-9d48-6e06837fa478 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:13.068954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003b730-9b6d-47c1-b0ad-1077fb6ba93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:13.070107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003b730-9b6d-47c1-b0ad-1077fb6ba93f None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:13.070384 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003b730-9b6d-47c1-b0ad-1077fb6ba93f None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:13.070661 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003b730-9b6d-47c1-b0ad-1077fb6ba93f None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:13.071357 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003b730-9b6d-47c1-b0ad-1077fb6ba93f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:13.071662 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003b730-9b6d-47c1-b0ad-1077fb6ba93f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:13.073030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003b730-9b6d-47c1-b0ad-1077fb6ba93f None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:13.078073 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 377/771] 10.222.0.71 () {56 vars in 1126 bytes} [Thu Jul 28 11:05:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:05:13.083842 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003b730-9b6d-47c1-b0ad-1077fb6ba93f None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:13.098122 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:13.161141 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308c168-7e78-456d-9d48-6e06837fa478 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:13.191449 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003b730-9b6d-47c1-b0ad-1077fb6ba93f None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:13.195662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ca9ef-a142-443d-ad15-5e1c608981d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:13.196405 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ca9ef-a142-443d-ad15-5e1c608981d7 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:13.196598 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ca9ef-a142-443d-ad15-5e1c608981d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:13.196880 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ca9ef-a142-443d-ad15-5e1c608981d7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:13.197510 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ca9ef-a142-443d-ad15-5e1c608981d7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:13.198885 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ca9ef-a142-443d-ad15-5e1c608981d7 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:13.207909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-534ca9ef-a142-443d-ad15-5e1c608981d7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 11:05:13.207909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:13.207909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:05:13.207909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:05:13.207909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:05:13.207909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:05:13.207909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:05:13.207909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:13.207909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 11:05:13.207909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:13.207909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:05:13.207909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:13.207909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:13.207909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:13.207909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:13.207909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:13.207909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:13.209045 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:13.209045 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:13.209045 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:13.209045 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:13.209045 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:13.209045 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:13.209045 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:05:13.209045 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:05:13.209045 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:05:13.209045 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:05:13.209045 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:13.209045 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:13.209045 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:13.209045 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:13.209045 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:13.209045 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:13.210202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:13.210202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:13.210202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:13.210202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:13.210202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:13.210202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:13.210202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:13.210202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:13.210202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:13.210202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:13.210202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:05:13.210202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:13.210202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 11:05:13.210202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:13.210202 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 395/772] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:05:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:05:13.218872 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ca9ef-a142-443d-ad15-5e1c608981d7 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:13.226617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221b11b-4843-4686-ba1d-07ec373a9ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:13.227245 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221b11b-4843-4686-ba1d-07ec373a9ee3 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:13.227561 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221b11b-4843-4686-ba1d-07ec373a9ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:13.227837 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221b11b-4843-4686-ba1d-07ec373a9ee3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:13.228595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221b11b-4843-4686-ba1d-07ec373a9ee3 None admin] RBAC: Adding query filter params (interface=public, service_id=d9941489995643078fdab7f4e361deb9, region_id=RegionOne) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:13.228899 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221b11b-4843-4686-ba1d-07ec373a9ee3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:13.230270 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221b11b-4843-4686-ba1d-07ec373a9ee3 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:13.235654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 378/773] 10.222.0.71 () {56 vars in 1251 bytes} [Thu Jul 28 11:05:13 2022] GET /identity/v3/endpoints?service_id=d9941489995643078fdab7f4e361deb9&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:05:13.241763 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221b11b-4843-4686-ba1d-07ec373a9ee3 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:13.281983 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:13.326721 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ca9ef-a142-443d-ad15-5e1c608981d7 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:13.335731 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:13.345541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221b11b-4843-4686-ba1d-07ec373a9ee3 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:13.360993 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2b6c8-52c3-40be-b956-02352f15ae98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:13.361619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2b6c8-52c3-40be-b956-02352f15ae98 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:13.361900 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2b6c8-52c3-40be-b956-02352f15ae98 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:13.362180 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2b6c8-52c3-40be-b956-02352f15ae98 None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:13.362856 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2b6c8-52c3-40be-b956-02352f15ae98 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:13.363193 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2b6c8-52c3-40be-b956-02352f15ae98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:13.364652 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2b6c8-52c3-40be-b956-02352f15ae98 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:13.369926 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 396/774] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:05:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:05:13.375827 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2b6c8-52c3-40be-b956-02352f15ae98 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:13.381700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbc164-2377-4fb9-8656-a60ce720a2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:13.382879 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbc164-2377-4fb9-8656-a60ce720a2b2 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:13.383182 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbc164-2377-4fb9-8656-a60ce720a2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:13.383686 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbc164-2377-4fb9-8656-a60ce720a2b2 None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:13.384338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbc164-2377-4fb9-8656-a60ce720a2b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:13.385714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbc164-2377-4fb9-8656-a60ce720a2b2 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:13.392180 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 379/775] 10.222.0.71 () {56 vars in 1087 bytes} [Thu Jul 28 11:05:13 2022] GET /identity/v3/services => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 11:05:13.488347 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2b6c8-52c3-40be-b956-02352f15ae98 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:13.524889 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55c85b-efbd-4f32-abdb-0dd57ddea326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:13.525531 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55c85b-efbd-4f32-abdb-0dd57ddea326 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:13.525816 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55c85b-efbd-4f32-abdb-0dd57ddea326 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:13.526097 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55c85b-efbd-4f32-abdb-0dd57ddea326 None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:13.526797 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55c85b-efbd-4f32-abdb-0dd57ddea326 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:13.527107 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55c85b-efbd-4f32-abdb-0dd57ddea326 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:13.528551 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55c85b-efbd-4f32-abdb-0dd57ddea326 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:13.534063 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 397/776] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:05:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:13.540655 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbc164-2377-4fb9-8656-a60ce720a2b2 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:13.643873 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbc164-2377-4fb9-8656-a60ce720a2b2 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:13.645424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:13.680452 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610ae06-9960-4888-bf4a-9387aa1ec2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:13.681072 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610ae06-9960-4888-bf4a-9387aa1ec2b9 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:13.681349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610ae06-9960-4888-bf4a-9387aa1ec2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:13.681619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610ae06-9960-4888-bf4a-9387aa1ec2b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:13.682363 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610ae06-9960-4888-bf4a-9387aa1ec2b9 None admin] RBAC: Adding query filter params (interface=public, service_id=93fdf42af2cd4dc78f8b2c257541aba4, region_id=RegionOne) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:13.682674 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610ae06-9960-4888-bf4a-9387aa1ec2b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:13.684102 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610ae06-9960-4888-bf4a-9387aa1ec2b9 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:13.689193 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 380/777] 10.222.0.71 () {56 vars in 1251 bytes} [Thu Jul 28 11:05:13 2022] GET /identity/v3/endpoints?service_id=93fdf42af2cd4dc78f8b2c257541aba4&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:13.695208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55c85b-efbd-4f32-abdb-0dd57ddea326 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:13.731210 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:13.797238 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55c85b-efbd-4f32-abdb-0dd57ddea326 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:13.832678 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b39af4-2fee-4152-b6df-389e8209a86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:13.833317 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b39af4-2fee-4152-b6df-389e8209a86f None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:13.833600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b39af4-2fee-4152-b6df-389e8209a86f None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:13.833879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b39af4-2fee-4152-b6df-389e8209a86f None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:13.834542 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b39af4-2fee-4152-b6df-389e8209a86f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:13.836511 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b39af4-2fee-4152-b6df-389e8209a86f None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:13.842829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 398/778] 10.222.0.71 () {56 vars in 1087 bytes} [Thu Jul 28 11:05:13 2022] GET /identity/v3/services => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 11:05:15.658375 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5894c-d91d-42eb-a95e-51078e735e10 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:15.658878 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5894c-d91d-42eb-a95e-51078e735e10 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:15.658878 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5894c-d91d-42eb-a95e-51078e735e10 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:15.660185 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 381/779] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:05:15.666349 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5644fa6-dcdf-4f69-adeb-8a4b129c30be None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:15.666783 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5644fa6-dcdf-4f69-adeb-8a4b129c30be None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:15.666903 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5644fa6-dcdf-4f69-adeb-8a4b129c30be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:15.684897 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-f5644fa6-dcdf-4f69-adeb-8a4b129c30be None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:15.686121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-f5644fa6-dcdf-4f69-adeb-8a4b129c30be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:15.755346 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 399/780] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:15 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:05:15.779493 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5894c-d91d-42eb-a95e-51078e735e10 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:15.889942 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5894c-d91d-42eb-a95e-51078e735e10 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:15.929751 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c8878-5b1b-443d-9327-9cb7307eb21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:15.930323 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c8878-5b1b-443d-9327-9cb7307eb21a None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:15.930606 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c8878-5b1b-443d-9327-9cb7307eb21a None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:15.930882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c8878-5b1b-443d-9327-9cb7307eb21a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:15.931546 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c8878-5b1b-443d-9327-9cb7307eb21a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:15.932935 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c8878-5b1b-443d-9327-9cb7307eb21a None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:15.942231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-c62c8878-5b1b-443d-9327-9cb7307eb21a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 11:05:15.942231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:15.942231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:05:15.942231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:05:15.942231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:05:15.942231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:05:15.942231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:05:15.942231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:15.942231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 11:05:15.942231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:15.942231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:05:15.942231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:15.942231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:15.942231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:15.942231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:15.942231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:15.943147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:15.943147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:15.943147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:15.943147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:15.943147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:15.943147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:15.943147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:15.943147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:05:15.943147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:05:15.943147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:05:15.943147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:05:15.943147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:15.943147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:15.943147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:15.943147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:15.943147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:15.943996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:15.943996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:15.943996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:15.943996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:15.943996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:15.943996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:15.943996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:15.943996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:15.943996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:15.943996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:15.943996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:15.943996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:05:15.943996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:15.943996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 11:05:15.943996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:15.943996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 382/781] 10.222.0.71 () {56 vars in 1132 bytes} [Thu Jul 28 11:05:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:05:15.949382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5644fa6-dcdf-4f69-adeb-8a4b129c30be None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:15.979393 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:16.048791 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5644fa6-dcdf-4f69-adeb-8a4b129c30be None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:16.057458 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4806818-efe6-404d-af6f-ff607eac8a87 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:16.057707 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4806818-efe6-404d-af6f-ff607eac8a87 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:16.057988 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4806818-efe6-404d-af6f-ff607eac8a87 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:16.059361 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 383/782] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:05:16.064325 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944266a-4c58-4a2c-a086-23fcbff74782 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:16.064606 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944266a-4c58-4a2c-a086-23fcbff74782 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:16.064881 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944266a-4c58-4a2c-a086-23fcbff74782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:16.083520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-d944266a-4c58-4a2c-a086-23fcbff74782 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:16.084719 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-d944266a-4c58-4a2c-a086-23fcbff74782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:16.086195 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0389ab-fd85-4143-bac5-0d81a2f9581e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:16.086827 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0389ab-fd85-4143-bac5-0d81a2f9581e None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:16.087112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0389ab-fd85-4143-bac5-0d81a2f9581e None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:16.088123 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0389ab-fd85-4143-bac5-0d81a2f9581e None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:16.088123 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0389ab-fd85-4143-bac5-0d81a2f9581e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:16.088380 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0389ab-fd85-4143-bac5-0d81a2f9581e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:16.089727 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0389ab-fd85-4143-bac5-0d81a2f9581e None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:16.094465 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 400/783] 10.222.0.71 () {56 vars in 1126 bytes} [Thu Jul 28 11:05:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:05:16.100101 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0389ab-fd85-4143-bac5-0d81a2f9581e None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:16.109461 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:16.153481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 384/784] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:16 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 11:05:16.180652 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944266a-4c58-4a2c-a086-23fcbff74782 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:16.198710 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:16.205635 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0389ab-fd85-4143-bac5-0d81a2f9581e None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:16.241665 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7005e6-ac63-476f-93fc-d6836fb27852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:16.242350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7005e6-ac63-476f-93fc-d6836fb27852 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:16.242634 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7005e6-ac63-476f-93fc-d6836fb27852 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:16.242904 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7005e6-ac63-476f-93fc-d6836fb27852 None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:16.243628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7005e6-ac63-476f-93fc-d6836fb27852 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:16.243930 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7005e6-ac63-476f-93fc-d6836fb27852 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:16.245611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7005e6-ac63-476f-93fc-d6836fb27852 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:16.251335 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 401/785] 10.222.0.71 () {56 vars in 1126 bytes} [Thu Jul 28 11:05:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:05:16.257089 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7005e6-ac63-476f-93fc-d6836fb27852 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:16.286728 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944266a-4c58-4a2c-a086-23fcbff74782 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:16.322924 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac4733-c6fd-4f80-95d6-ad9872a81b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:16.323607 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac4733-c6fd-4f80-95d6-ad9872a81b30 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:16.323898 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac4733-c6fd-4f80-95d6-ad9872a81b30 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:16.324178 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac4733-c6fd-4f80-95d6-ad9872a81b30 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:16.324805 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac4733-c6fd-4f80-95d6-ad9872a81b30 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:16.326198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac4733-c6fd-4f80-95d6-ad9872a81b30 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:16.336010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-20ac4733-c6fd-4f80-95d6-ad9872a81b30 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 11:05:16.336010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:16.336010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:05:16.336010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:05:16.336010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:05:16.336010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:05:16.336010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:05:16.336010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:16.336010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 11:05:16.336010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:16.336010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:05:16.336010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:16.336010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:16.336010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:16.336010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:16.336010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:16.336010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:16.337221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:16.337221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:16.337221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:16.337221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:16.337221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:16.337221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:16.337221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:05:16.337221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:05:16.337221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:05:16.337221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:05:16.337221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:16.337221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:16.337221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:16.337221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:16.337221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:16.337221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:16.338086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:16.338086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:16.338086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:16.338086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:16.338086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:16.338086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:16.338086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:16.338086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:16.338086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:16.338086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:16.338086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:05:16.338086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:16.338086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 11:05:16.338086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:16.338086 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 385/786] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:05:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:05:16.343054 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac4733-c6fd-4f80-95d6-ad9872a81b30 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:16.365720 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7005e6-ac63-476f-93fc-d6836fb27852 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:16.370174 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:16.403403 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5c135-07e2-45ea-b245-077df8b9e3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:16.404034 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5c135-07e2-45ea-b245-077df8b9e3d7 None admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:16.404316 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5c135-07e2-45ea-b245-077df8b9e3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:16.404593 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5c135-07e2-45ea-b245-077df8b9e3d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:16.405298 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5c135-07e2-45ea-b245-077df8b9e3d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:16.406701 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5c135-07e2-45ea-b245-077df8b9e3d7 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:16.428492 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 402/787] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Jul 28 11:05:16 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 11:05:16.452320 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac4733-c6fd-4f80-95d6-ad9872a81b30 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:16.498168 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dd4c7-557d-4250-ad14-430c728faa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:16.498805 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dd4c7-557d-4250-ad14-430c728faa51 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:16.499129 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dd4c7-557d-4250-ad14-430c728faa51 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:16.499466 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dd4c7-557d-4250-ad14-430c728faa51 None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:16.500299 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1dd4c7-557d-4250-ad14-430c728faa51 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:16.500660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1dd4c7-557d-4250-ad14-430c728faa51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:16.502311 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1dd4c7-557d-4250-ad14-430c728faa51 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:16.508668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 386/788] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:05:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:05:16.514882 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5c135-07e2-45ea-b245-077df8b9e3d7 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:16.533955 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:16.635021 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5c135-07e2-45ea-b245-077df8b9e3d7 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:16.671626 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22efae3-e564-4cda-bc56-d99c2272db7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:16.672290 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22efae3-e564-4cda-bc56-d99c2272db7b None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:16.672491 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22efae3-e564-4cda-bc56-d99c2272db7b None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:16.672767 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22efae3-e564-4cda-bc56-d99c2272db7b None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:16.673449 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22efae3-e564-4cda-bc56-d99c2272db7b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:16.673753 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22efae3-e564-4cda-bc56-d99c2272db7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:16.675139 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22efae3-e564-4cda-bc56-d99c2272db7b None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:16.680889 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 403/789] 10.222.0.71 () {56 vars in 1114 bytes} [Thu Jul 28 11:05:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:05:16.686922 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dd4c7-557d-4250-ad14-430c728faa51 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:16.774083 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:16.790557 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dd4c7-557d-4250-ad14-430c728faa51 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:16.824494 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3410d60-2c51-4965-83ed-69e69aade983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:16.825122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3410d60-2c51-4965-83ed-69e69aade983 None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:16.825399 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3410d60-2c51-4965-83ed-69e69aade983 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:16.825669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3410d60-2c51-4965-83ed-69e69aade983 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:16.826387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3410d60-2c51-4965-83ed-69e69aade983 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:16.827823 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3410d60-2c51-4965-83ed-69e69aade983 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:16.863300 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 387/790] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Jul 28 11:05:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:05:18.729923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa2568-1797-4768-8e01-b6c7a042ec6f None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:18.730422 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa2568-1797-4768-8e01-b6c7a042ec6f None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:18.730422 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa2568-1797-4768-8e01-b6c7a042ec6f None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:18.731958 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 404/791] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:05:18.737504 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5053a0a-21ce-4c5d-8843-23d16c6f50f2 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:18.737935 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5053a0a-21ce-4c5d-8843-23d16c6f50f2 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:18.738055 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5053a0a-21ce-4c5d-8843-23d16c6f50f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:18.756876 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-d5053a0a-21ce-4c5d-8843-23d16c6f50f2 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:18.758058 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-d5053a0a-21ce-4c5d-8843-23d16c6f50f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:18.833853 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 388/792] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:18 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 11:05:18.858567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa2568-1797-4768-8e01-b6c7a042ec6f None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:18.939028 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:18.963127 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa2568-1797-4768-8e01-b6c7a042ec6f None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:19.000894 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1ecd5-f9c3-43c0-8475-6ac444a6d1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:19.001473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1ecd5-f9c3-43c0-8475-6ac444a6d1f1 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:19.001755 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1ecd5-f9c3-43c0-8475-6ac444a6d1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:19.002030 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1ecd5-f9c3-43c0-8475-6ac444a6d1f1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:19.002675 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1ecd5-f9c3-43c0-8475-6ac444a6d1f1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:19.004114 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1ecd5-f9c3-43c0-8475-6ac444a6d1f1 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:19.014596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-eee1ecd5-f9c3-43c0-8475-6ac444a6d1f1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 11:05:19.014596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:19.014596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:05:19.014596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:05:19.014596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:05:19.014596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:05:19.014596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:05:19.014596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:19.014596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 11:05:19.014596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:19.014596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:05:19.014596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:19.014596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:19.014596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:19.014596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:19.014596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:19.014596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:19.015780 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:19.015780 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:19.015780 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:19.015780 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:19.015780 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:19.015780 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:19.015780 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:05:19.015780 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:05:19.015780 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:05:19.015780 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:05:19.015780 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:19.015780 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:19.015780 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:19.015780 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:19.015780 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:19.015780 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:19.016616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:19.016616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:19.016616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:19.016616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:19.016616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:19.016616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:19.016616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:19.016616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:19.016616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:19.016616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:19.016616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:05:19.016616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:19.016616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 11:05:19.016616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:19.016616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 405/793] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:05:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:05:19.021751 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5053a0a-21ce-4c5d-8843-23d16c6f50f2 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:19.088807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:19.125885 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5053a0a-21ce-4c5d-8843-23d16c6f50f2 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:19.138026 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bbb25-dec8-4976-9b57-239858a35a72 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:19.138315 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bbb25-dec8-4976-9b57-239858a35a72 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:19.138625 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bbb25-dec8-4976-9b57-239858a35a72 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:19.139998 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 406/794] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:05:19.145052 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d869b-7ded-4a89-80b6-a6c19588dcf3 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:19.145336 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d869b-7ded-4a89-80b6-a6c19588dcf3 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:19.145612 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d869b-7ded-4a89-80b6-a6c19588dcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:19.162726 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb3f3e-dff1-4fd0-bb5c-4fa1318d16f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:19.163426 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb3f3e-dff1-4fd0-bb5c-4fa1318d16f8 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:19.163711 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb3f3e-dff1-4fd0-bb5c-4fa1318d16f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:19.163947 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-943d869b-7ded-4a89-80b6-a6c19588dcf3 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:19.164045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb3f3e-dff1-4fd0-bb5c-4fa1318d16f8 None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:19.164650 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb3f3e-dff1-4fd0-bb5c-4fa1318d16f8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:19.164954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb3f3e-dff1-4fd0-bb5c-4fa1318d16f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:19.165163 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-943d869b-7ded-4a89-80b6-a6c19588dcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:19.166334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb3f3e-dff1-4fd0-bb5c-4fa1318d16f8 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:19.172070 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 389/795] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Jul 28 11:05:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:19.177949 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb3f3e-dff1-4fd0-bb5c-4fa1318d16f8 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:19.236540 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 407/796] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:19 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 11:05:19.261651 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d869b-7ded-4a89-80b6-a6c19588dcf3 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:19.282394 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb3f3e-dff1-4fd0-bb5c-4fa1318d16f8 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:19.316126 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:19.322873 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf0aa8-1e88-46b7-a955-470614f7640d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:19.323534 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf0aa8-1e88-46b7-a955-470614f7640d None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:19.323816 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf0aa8-1e88-46b7-a955-470614f7640d None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:19.324095 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf0aa8-1e88-46b7-a955-470614f7640d None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:19.324768 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf0aa8-1e88-46b7-a955-470614f7640d None admin] RBAC: Adding query filter params (type=compute) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:19.325074 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf0aa8-1e88-46b7-a955-470614f7640d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:19.326459 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf0aa8-1e88-46b7-a955-470614f7640d None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:19.331027 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 390/797] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Jul 28 11:05:19 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:19.331251 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:19.378011 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d869b-7ded-4a89-80b6-a6c19588dcf3 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:19.417585 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45ae94-7ddc-4bdd-848b-1a8e64332d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:19.418262 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45ae94-7ddc-4bdd-848b-1a8e64332d4d None admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:19.418504 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45ae94-7ddc-4bdd-848b-1a8e64332d4d None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:19.418781 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45ae94-7ddc-4bdd-848b-1a8e64332d4d None admin] PATH_INFO: `/v3/projects` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:19.419556 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45ae94-7ddc-4bdd-848b-1a8e64332d4d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:19.421043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45ae94-7ddc-4bdd-848b-1a8e64332d4d None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:19.423826 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: WARNING keystone.server.flask.common [None req-cd45ae94-7ddc-4bdd-848b-1a8e64332d4d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 11:05:19.443621 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.sql.core [None req-cd45ae94-7ddc-4bdd-848b-1a8e64332d4d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 11:05:19.443621 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 11:05:19.443621 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [parameters: {'id': '7a1a07e1757d47c0ac4e7c764247b230', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 11:05:19.443621 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87205) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 11:05:19.461578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-cd45ae94-7ddc-4bdd-848b-1a8e64332d4d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7a1a07e1757d47c0ac4e7c764247b230.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7a1a07e1757d47c0ac4e7c764247b230. Jul 28 11:05:19.461578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:19.461578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 11:05:19.461578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 11:05:19.461578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 11:05:19.461578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 11:05:19.461578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 11:05:19.461578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 11:05:19.461578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 11:05:19.461578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application conn.query(q) Jul 28 11:05:19.461578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 11:05:19.461578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 11:05:19.461578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 11:05:19.462716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application result.read() Jul 28 11:05:19.462716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 11:05:19.462716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 11:05:19.462716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 11:05:19.462716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 11:05:19.462716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 11:05:19.462716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 11:05:19.462716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 11:05:19.462716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 11:05:19.462716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 11:05:19.462716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:19.462716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 11:05:19.462716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:19.462716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:19.462716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 11:05:19.462716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 11:05:19.462716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 28 11:05:19.462716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 28 11:05:19.463850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 11:05:19.463850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application next(self.gen) Jul 28 11:05:19.463850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 11:05:19.463850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application yield resource Jul 28 11:05:19.463850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 11:05:19.463850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application next(self.gen) Jul 28 11:05:19.463850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 11:05:19.463850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 11:05:19.463850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:05:19.463850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 11:05:19.463850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:05:19.463850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise self.value Jul 28 11:05:19.463850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 11:05:19.463850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 11:05:19.463850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 11:05:19.463850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application session.commit() Jul 28 11:05:19.463850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 11:05:19.464792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 11:05:19.464792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 11:05:19.464792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 11:05:19.464792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 11:05:19.464792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self.session.flush() Jul 28 11:05:19.464792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 11:05:19.464792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 11:05:19.464792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 11:05:19.464792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 11:05:19.464792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 11:05:19.464792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application compat.raise_( Jul 28 11:05:19.464792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 11:05:19.464792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception Jul 28 11:05:19.464792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 11:05:19.464792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 11:05:19.464792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 11:05:19.464792 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 11:05:19.465737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 11:05:19.465737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 11:05:19.465737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 11:05:19.465737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 11:05:19.465737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 11:05:19.465737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 11:05:19.465737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 11:05:19.465737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 11:05:19.465737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 11:05:19.465737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 11:05:19.465737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 11:05:19.465737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 11:05:19.465737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 11:05:19.465737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 11:05:19.465737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 11:05:19.466534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 11:05:19.466534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 11:05:19.466534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception Jul 28 11:05:19.466534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 11:05:19.466534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 11:05:19.466534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 11:05:19.466534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 11:05:19.466534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 11:05:19.466534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 11:05:19.466534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 11:05:19.466534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application conn.query(q) Jul 28 11:05:19.466534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 11:05:19.466534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 11:05:19.466534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 11:05:19.466534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application result.read() Jul 28 11:05:19.466534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 11:05:19.466534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 11:05:19.467473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 11:05:19.467473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 11:05:19.467473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 11:05:19.467473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 11:05:19.467473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 11:05:19.467473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 11:05:19.467473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 11:05:19.467473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 11:05:19.467473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [parameters: {'id': '7a1a07e1757d47c0ac4e7c764247b230', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 11:05:19.467473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 11:05:19.467473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:19.467473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:05:19.467473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:19.467473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:19.467473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 28 11:05:19.468624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 28 11:05:19.468624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 11:05:19.468624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 11:05:19.468624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 28 11:05:19.468624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:19.468624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:05:19.468624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:19.468624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:19.468624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:19.468624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:19.468624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:19.468624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:19.468624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:19.468624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:19.468624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:19.468624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:19.468624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:19.470089 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:19.470089 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 28 11:05:19.470089 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 28 11:05:19.470089 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:19.470089 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:19.470089 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 28 11:05:19.470089 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 28 11:05:19.470089 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7a1a07e1757d47c0ac4e7c764247b230. Jul 28 11:05:19.470089 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:19.470089 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 408/798] 10.222.0.71 () {60 vars in 1140 bytes} [Thu Jul 28 11:05:19 2022] POST /identity/v3/projects => generated 262 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:05:19.472497 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf0aa8-1e88-46b7-a955-470614f7640d None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:19.596040 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf0aa8-1e88-46b7-a955-470614f7640d None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:19.632309 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda1970-e62b-49db-9753-9bdd26657846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:19.632964 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda1970-e62b-49db-9753-9bdd26657846 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:19.633435 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda1970-e62b-49db-9753-9bdd26657846 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:19.633717 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda1970-e62b-49db-9753-9bdd26657846 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:19.641071 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda1970-e62b-49db-9753-9bdd26657846 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:19.642542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda1970-e62b-49db-9753-9bdd26657846 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:19.654501 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-0dda1970-e62b-49db-9753-9bdd26657846 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:05:19.654501 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:19.654501 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:19.654501 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:19.654501 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:19.654501 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:19.654501 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:19.654501 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:19.654501 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:19.654501 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:19.654501 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:19.654501 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:19.654501 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:05:19.654501 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:05:19.654501 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:05:19.655653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:05:19.655653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:19.655653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:19.655653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:19.655653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:19.655653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:19.655653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:19.655653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:19.655653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:19.655653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:19.655653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:19.655653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:19.655653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:19.655653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:19.655653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:19.655653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:19.655653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:19.656551 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:05:19.656551 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:05:19.656551 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:05:19.656551 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:05:19.656551 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:05:19.656551 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:05:19.656551 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:05:19.656551 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:19.656551 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 391/799] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:05:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:05:19.661906 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45ae94-7ddc-4bdd-848b-1a8e64332d4d None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:19.766178 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45ae94-7ddc-4bdd-848b-1a8e64332d4d None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:19.793303 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:19.802514 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982dfba-d535-4ddd-9e53-3a98c0cedb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:19.803077 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982dfba-d535-4ddd-9e53-3a98c0cedb7c None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:19.803400 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982dfba-d535-4ddd-9e53-3a98c0cedb7c None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:19.803697 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982dfba-d535-4ddd-9e53-3a98c0cedb7c None admin] PATH_INFO: `/v3/projects` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:19.804999 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982dfba-d535-4ddd-9e53-3a98c0cedb7c None admin] RBAC: Adding query filter params (name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:19.805306 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982dfba-d535-4ddd-9e53-3a98c0cedb7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:19.806948 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982dfba-d535-4ddd-9e53-3a98c0cedb7c None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:19.829038 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 409/800] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Jul 28 11:05:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:21.622112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35d3d2-4ff1-40ea-af93-06a7831e4df4 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:21.622634 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35d3d2-4ff1-40ea-af93-06a7831e4df4 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:21.622634 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35d3d2-4ff1-40ea-af93-06a7831e4df4 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:21.624203 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 392/801] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:05:21.629370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7c3b5-b518-4daf-946a-8668a95c1498 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:21.629804 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7c3b5-b518-4daf-946a-8668a95c1498 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:21.629957 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7c3b5-b518-4daf-946a-8668a95c1498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:21.649959 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-08d7c3b5-b518-4daf-946a-8668a95c1498 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:21.651479 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-08d7c3b5-b518-4daf-946a-8668a95c1498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:21.718089 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 410/802] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:21 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:05:21.742683 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35d3d2-4ff1-40ea-af93-06a7831e4df4 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:21.802795 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:21.849247 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35d3d2-4ff1-40ea-af93-06a7831e4df4 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:21.883585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2456e6-8da0-4d47-8633-801c630cbb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:21.884129 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2456e6-8da0-4d47-8633-801c630cbb48 None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:21.884413 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2456e6-8da0-4d47-8633-801c630cbb48 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:21.884692 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2456e6-8da0-4d47-8633-801c630cbb48 None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:21.885387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2456e6-8da0-4d47-8633-801c630cbb48 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:21.886770 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2456e6-8da0-4d47-8633-801c630cbb48 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:21.902253 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 393/803] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Jul 28 11:05:21 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:05:22.117268 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bae27-8fb6-46bc-a42f-3927bed87f94 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:22.117553 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bae27-8fb6-46bc-a42f-3927bed87f94 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:22.117835 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bae27-8fb6-46bc-a42f-3927bed87f94 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:22.119189 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 411/804] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:05:22.124644 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a218efd-9d5a-451a-9933-a1d7d937d2ce None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:22.124931 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a218efd-9d5a-451a-9933-a1d7d937d2ce None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:22.125207 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a218efd-9d5a-451a-9933-a1d7d937d2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:22.144540 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-0a218efd-9d5a-451a-9933-a1d7d937d2ce None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:22.145686 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-0a218efd-9d5a-451a-9933-a1d7d937d2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:22.221159 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 394/805] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:22 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:05:22.246578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bae27-8fb6-46bc-a42f-3927bed87f94 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:22.349853 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bae27-8fb6-46bc-a42f-3927bed87f94 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:22.368315 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:22.387072 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ed305-dc64-499b-b377-fd392cd5594f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:22.387749 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ed305-dc64-499b-b377-fd392cd5594f None admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:22.388028 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ed305-dc64-499b-b377-fd392cd5594f None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:22.388303 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ed305-dc64-499b-b377-fd392cd5594f None admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:22.388994 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ed305-dc64-499b-b377-fd392cd5594f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:22.390457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ed305-dc64-499b-b377-fd392cd5594f None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:22.406488 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.sql.core [None req-687ed305-dc64-499b-b377-fd392cd5594f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 11:05:22.406488 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 11:05:22.406488 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [parameters: {'user_id': 'a4af5bb9141940689d84bc918b1f33a2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 11:05:22.406488 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87205) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 11:05:22.413112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-687ed305-dc64-499b-b377-fd392cd5594f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 11:05:22.413112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:22.413112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 11:05:22.413112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 11:05:22.413112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 11:05:22.413112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 11:05:22.413112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 11:05:22.413112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 11:05:22.413112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 11:05:22.413112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application conn.query(q) Jul 28 11:05:22.413112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 11:05:22.413112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 11:05:22.413112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 11:05:22.413112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application result.read() Jul 28 11:05:22.413112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 11:05:22.414255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 11:05:22.414255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 11:05:22.414255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 11:05:22.414255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 11:05:22.414255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 11:05:22.414255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 11:05:22.414255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 11:05:22.414255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 11:05:22.414255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:22.414255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 11:05:22.414255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:22.414255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:22.414255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 11:05:22.414255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 11:05:22.414255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 28 11:05:22.414255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 28 11:05:22.414255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 11:05:22.414255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application next(self.gen) Jul 28 11:05:22.415242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 11:05:22.415242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application yield resource Jul 28 11:05:22.415242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 11:05:22.415242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application next(self.gen) Jul 28 11:05:22.415242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 11:05:22.415242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 11:05:22.415242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 11:05:22.415242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 11:05:22.415242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 11:05:22.415242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise self.value Jul 28 11:05:22.415242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 11:05:22.415242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 11:05:22.415242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 11:05:22.415242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application session.commit() Jul 28 11:05:22.415242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 11:05:22.415242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 11:05:22.415242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 11:05:22.416149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 11:05:22.416149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 11:05:22.416149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self.session.flush() Jul 28 11:05:22.416149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 11:05:22.416149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 11:05:22.416149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 11:05:22.416149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 11:05:22.416149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 11:05:22.416149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application compat.raise_( Jul 28 11:05:22.416149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 11:05:22.416149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception Jul 28 11:05:22.416149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 11:05:22.416149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 11:05:22.416149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 11:05:22.416149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 11:05:22.416149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 11:05:22.416149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 11:05:22.417009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 11:05:22.417009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 11:05:22.417009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 11:05:22.417009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 28 11:05:22.417009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 11:05:22.417009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 11:05:22.417009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 11:05:22.417009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 11:05:22.417009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 11:05:22.417009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 11:05:22.417009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 11:05:22.417009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 11:05:22.417009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 11:05:22.417009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 11:05:22.417009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 11:05:22.417009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception Jul 28 11:05:22.417823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 11:05:22.417823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 11:05:22.417823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 11:05:22.417823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 11:05:22.417823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 11:05:22.417823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 11:05:22.417823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 11:05:22.417823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application conn.query(q) Jul 28 11:05:22.417823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 11:05:22.417823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 11:05:22.417823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 11:05:22.417823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application result.read() Jul 28 11:05:22.417823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 11:05:22.417823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 11:05:22.417823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 11:05:22.417823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 11:05:22.418681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 11:05:22.418681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 11:05:22.418681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 11:05:22.418681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 11:05:22.418681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 11:05:22.418681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 11:05:22.418681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a4af5bb9141940689d84bc918b1f33a2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 11:05:22.418681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 11:05:22.418681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:22.418681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:05:22.418681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:22.418681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:22.418681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:22.418681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:22.418681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:22.419699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:22.419699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:22.419699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:22.419699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:22.419699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:22.419699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:22.419699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:22.419699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 28 11:05:22.419699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 28 11:05:22.419699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:22.419699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:22.419699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:05:22.419699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:05:22.419699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:05:22.419699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:05:22.419699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 28 11:05:22.419699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 28 11:05:22.420663 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 28 11:05:22.420663 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 28 11:05:22.420663 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 11:05:22.420663 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 11:05:22.420663 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 11:05:22.420663 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:22.420663 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 412/806] 10.222.0.71 () {60 vars in 1131 bytes} [Thu Jul 28 11:05:22 2022] POST /identity/v3/users => generated 160 bytes in 168 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:05:22.421967 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a218efd-9d5a-451a-9933-a1d7d937d2ce None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:22.466983 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:22.531950 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a218efd-9d5a-451a-9933-a1d7d937d2ce None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:22.566692 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45127300-19aa-4e4f-a8a5-c621ab8e5ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:22.567449 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45127300-19aa-4e4f-a8a5-c621ab8e5ed5 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:22.567734 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45127300-19aa-4e4f-a8a5-c621ab8e5ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:22.568009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45127300-19aa-4e4f-a8a5-c621ab8e5ed5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:22.575444 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45127300-19aa-4e4f-a8a5-c621ab8e5ed5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:22.576906 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45127300-19aa-4e4f-a8a5-c621ab8e5ed5 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:22.588671 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-45127300-19aa-4e4f-a8a5-c621ab8e5ed5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 11:05:22.588671 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:22.588671 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:22.588671 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:22.588671 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:22.588671 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:22.588671 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:22.588671 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:22.588671 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:22.588671 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:22.588671 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:22.588671 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:22.588671 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:05:22.588671 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:05:22.588671 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:05:22.588671 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:05:22.589654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:22.589654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:22.589654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:05:22.589654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:05:22.589654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:05:22.589654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:05:22.589654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:22.589654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:22.589654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:22.589654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:22.589654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:22.589654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:22.589654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:22.589654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:22.589654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:22.589654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:22.589654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:22.589654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:22.590604 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:22.590604 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:22.590604 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:05:22.590604 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:05:22.590604 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:05:22.590604 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:05:22.590604 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:05:22.590604 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:05:22.590604 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 11:05:22.590604 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:22.590604 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 395/807] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:05:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:05:22.595954 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ed305-dc64-499b-b377-fd392cd5594f None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:22.712630 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ed305-dc64-499b-b377-fd392cd5594f None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:22.750427 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614b74c-e7be-4097-846c-05bdca5ba067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:22.751056 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614b74c-e7be-4097-846c-05bdca5ba067 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:22.751369 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614b74c-e7be-4097-846c-05bdca5ba067 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:22.751649 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614b74c-e7be-4097-846c-05bdca5ba067 None admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:22.752433 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614b74c-e7be-4097-846c-05bdca5ba067 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:22.752731 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614b74c-e7be-4097-846c-05bdca5ba067 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:22.754367 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614b74c-e7be-4097-846c-05bdca5ba067 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:22.796044 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 413/808] 10.222.0.71 () {56 vars in 1101 bytes} [Thu Jul 28 11:05:22 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:24.159497 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcbf9c-6b05-4cba-82b3-9872bc834a24 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:24.160060 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcbf9c-6b05-4cba-82b3-9872bc834a24 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:24.160060 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcbf9c-6b05-4cba-82b3-9872bc834a24 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:24.161356 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 396/809] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:05:24.167222 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b71fe3-fe8c-4a18-bc25-5c8504d4122c None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:24.167680 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b71fe3-fe8c-4a18-bc25-5c8504d4122c None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:24.167818 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b71fe3-fe8c-4a18-bc25-5c8504d4122c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:24.186427 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-25b71fe3-fe8c-4a18-bc25-5c8504d4122c None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:24.188000 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-25b71fe3-fe8c-4a18-bc25-5c8504d4122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:24.217095 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:24.255334 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 414/810] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:24 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:05:24.279435 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcbf9c-6b05-4cba-82b3-9872bc834a24 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:24.376718 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:24.381284 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcbf9c-6b05-4cba-82b3-9872bc834a24 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:24.415469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db344cb-51b4-4840-8e70-cc95ed3c242e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:24.416040 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db344cb-51b4-4840-8e70-cc95ed3c242e None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:24.416328 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db344cb-51b4-4840-8e70-cc95ed3c242e None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:24.416609 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db344cb-51b4-4840-8e70-cc95ed3c242e None admin] PATH_INFO: `/v3/services/compute` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:24.417231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db344cb-51b4-4840-8e70-cc95ed3c242e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:24.418611 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db344cb-51b4-4840-8e70-cc95ed3c242e None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:24.427653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-5db344cb-51b4-4840-8e70-cc95ed3c242e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 11:05:24.427653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:24.427653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:05:24.427653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:05:24.427653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:05:24.427653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:05:24.427653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:05:24.427653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:24.427653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 11:05:24.427653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:24.427653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:05:24.427653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:24.427653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:24.427653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:24.427653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:24.427653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:24.427653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:24.429349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:24.429349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:24.429349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:24.429349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:24.429349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:24.429349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:24.429349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:05:24.429349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:05:24.429349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:05:24.429349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:05:24.429349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:24.429349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:24.429349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:24.429349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:24.429349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:24.429349 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:24.430189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:24.430189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:24.430189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:24.430189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:24.430189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:24.430189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:24.430189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:24.430189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:24.430189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:24.430189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:24.430189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:05:24.430189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:24.430189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 11:05:24.430189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:05:24.430189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 397/811] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:05:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:05:24.435533 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b71fe3-fe8c-4a18-bc25-5c8504d4122c None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:24.534153 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b71fe3-fe8c-4a18-bc25-5c8504d4122c None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:24.568852 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47377ce5-b0f5-44fe-8a57-6c8f89125362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:24.569496 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47377ce5-b0f5-44fe-8a57-6c8f89125362 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:24.569781 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47377ce5-b0f5-44fe-8a57-6c8f89125362 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:24.570057 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47377ce5-b0f5-44fe-8a57-6c8f89125362 None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:24.570736 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47377ce5-b0f5-44fe-8a57-6c8f89125362 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:24.571040 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47377ce5-b0f5-44fe-8a57-6c8f89125362 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:24.572461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47377ce5-b0f5-44fe-8a57-6c8f89125362 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:24.577230 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 415/812] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Jul 28 11:05:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:24.583451 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db344cb-51b4-4840-8e70-cc95ed3c242e None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:24.682595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db344cb-51b4-4840-8e70-cc95ed3c242e None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:24.714887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bd31a-cf9c-48c5-85fc-77a1501c0d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:24.715526 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bd31a-cf9c-48c5-85fc-77a1501c0d2f None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:24.715809 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bd31a-cf9c-48c5-85fc-77a1501c0d2f None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:24.716083 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bd31a-cf9c-48c5-85fc-77a1501c0d2f None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:24.716742 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133bd31a-cf9c-48c5-85fc-77a1501c0d2f None admin] RBAC: Adding query filter params (type=compute) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:24.717044 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133bd31a-cf9c-48c5-85fc-77a1501c0d2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:24.718424 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133bd31a-cf9c-48c5-85fc-77a1501c0d2f None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:24.723075 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 398/813] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Jul 28 11:05:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:24.729377 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47377ce5-b0f5-44fe-8a57-6c8f89125362 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:24.764530 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:24.833253 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47377ce5-b0f5-44fe-8a57-6c8f89125362 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:24.867281 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fcf62-50cc-4d36-b34e-8c96a9b6ca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:24.868230 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fcf62-50cc-4d36-b34e-8c96a9b6ca23 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:24.868502 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fcf62-50cc-4d36-b34e-8c96a9b6ca23 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:24.868776 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fcf62-50cc-4d36-b34e-8c96a9b6ca23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:24.869523 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fcf62-50cc-4d36-b34e-8c96a9b6ca23 None admin] RBAC: Adding query filter params (interface=public, service_id=2fd7b2db5af24ea0bf3e733aaf55c84b, region_id=RegionOne) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:24.869827 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fcf62-50cc-4d36-b34e-8c96a9b6ca23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:24.871183 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fcf62-50cc-4d36-b34e-8c96a9b6ca23 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:24.876248 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 416/814] 10.222.0.71 () {56 vars in 1251 bytes} [Thu Jul 28 11:05:24 2022] GET /identity/v3/endpoints?service_id=2fd7b2db5af24ea0bf3e733aaf55c84b&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:24.881936 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bd31a-cf9c-48c5-85fc-77a1501c0d2f None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:24.909649 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:24.979962 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bd31a-cf9c-48c5-85fc-77a1501c0d2f None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:25.012739 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214665e-4585-4357-aa03-3a850a425015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:25.013345 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214665e-4585-4357-aa03-3a850a425015 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:25.013624 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214665e-4585-4357-aa03-3a850a425015 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:25.013897 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214665e-4585-4357-aa03-3a850a425015 None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:25.014536 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214665e-4585-4357-aa03-3a850a425015 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:25.015925 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214665e-4585-4357-aa03-3a850a425015 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:25.021994 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 399/815] 10.222.0.71 () {56 vars in 1087 bytes} [Thu Jul 28 11:05:24 2022] GET /identity/v3/services => generated 1728 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 11:05:27.266641 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdcdf5-f812-4984-85e4-d05184432e60 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:27.267172 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdcdf5-f812-4984-85e4-d05184432e60 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:27.267172 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdcdf5-f812-4984-85e4-d05184432e60 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:27.268571 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 417/816] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:05:27.273810 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668f7f6-01d1-48ab-8386-c96f71934639 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:27.274192 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668f7f6-01d1-48ab-8386-c96f71934639 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:27.274372 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668f7f6-01d1-48ab-8386-c96f71934639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:27.292845 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-3668f7f6-01d1-48ab-8386-c96f71934639 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:05:27.294052 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-3668f7f6-01d1-48ab-8386-c96f71934639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:05:27.359470 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 400/817] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:05:27 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:05:27.383858 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdcdf5-f812-4984-85e4-d05184432e60 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:27.479439 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:27.486287 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdcdf5-f812-4984-85e4-d05184432e60 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:27.519067 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3aaf9-5b37-4fea-8053-4b82604db5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:27.519656 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3aaf9-5b37-4fea-8053-4b82604db5bc None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:27.519949 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3aaf9-5b37-4fea-8053-4b82604db5bc None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:27.520224 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3aaf9-5b37-4fea-8053-4b82604db5bc None admin] PATH_INFO: `/v3/services/compute` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:27.520842 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3aaf9-5b37-4fea-8053-4b82604db5bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:27.522198 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3aaf9-5b37-4fea-8053-4b82604db5bc None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:27.531396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-89f3aaf9-5b37-4fea-8053-4b82604db5bc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 11:05:27.531396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:27.531396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:05:27.531396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:05:27.531396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:05:27.531396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:05:27.531396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:05:27.531396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:27.531396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 11:05:27.531396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:27.531396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:05:27.531396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:27.531396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:05:27.531396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:05:27.531396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:05:27.531396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:05:27.531396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:05:27.532348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:05:27.532348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:05:27.532348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:05:27.532348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:05:27.532348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:05:27.532348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:05:27.532348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:05:27.532348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:05:27.532348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:05:27.532348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:05:27.532348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:05:27.532348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:05:27.532348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:05:27.532348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:05:27.532348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:05:27.532348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:05:27.533216 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:05:27.533216 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:05:27.533216 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:05:27.533216 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:05:27.533216 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:05:27.533216 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:05:27.533216 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:05:27.533216 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:05:27.533216 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:05:27.533216 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:05:27.533216 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:05:27.533216 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:05:27.533216 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 11:05:27.533216 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:05:27.533216 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 418/818] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:05:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:05:27.539102 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668f7f6-01d1-48ab-8386-c96f71934639 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:27.562599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:27.638260 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668f7f6-01d1-48ab-8386-c96f71934639 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:27.671855 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc54ea7-00b6-4eee-9eee-99f55018e094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:27.672472 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc54ea7-00b6-4eee-9eee-99f55018e094 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:27.672757 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc54ea7-00b6-4eee-9eee-99f55018e094 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:27.673034 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc54ea7-00b6-4eee-9eee-99f55018e094 None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:27.673712 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc54ea7-00b6-4eee-9eee-99f55018e094 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:27.674018 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc54ea7-00b6-4eee-9eee-99f55018e094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:27.675446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc54ea7-00b6-4eee-9eee-99f55018e094 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:27.680250 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 401/819] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Jul 28 11:05:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:27.686095 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3aaf9-5b37-4fea-8053-4b82604db5bc None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:27.787459 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3aaf9-5b37-4fea-8053-4b82604db5bc None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:27.823938 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3e379-47b3-4bac-b9b3-1b8b1598f984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:27.824566 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3e379-47b3-4bac-b9b3-1b8b1598f984 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:27.824852 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3e379-47b3-4bac-b9b3-1b8b1598f984 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:27.825278 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3e379-47b3-4bac-b9b3-1b8b1598f984 None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:27.825825 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3e379-47b3-4bac-b9b3-1b8b1598f984 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:05:27.826134 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3e379-47b3-4bac-b9b3-1b8b1598f984 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:27.827570 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3e379-47b3-4bac-b9b3-1b8b1598f984 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:27.833064 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 419/820] 10.222.0.71 () {56 vars in 1112 bytes} [Thu Jul 28 11:05:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:05:27.839065 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc54ea7-00b6-4eee-9eee-99f55018e094 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:05:27.927101 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:27.943085 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc54ea7-00b6-4eee-9eee-99f55018e094 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:05:27.976362 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b221222-417d-4196-8157-7c71e81533e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:05:27.976979 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b221222-417d-4196-8157-7c71e81533e0 None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:05:27.977265 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b221222-417d-4196-8157-7c71e81533e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:05:27.977540 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b221222-417d-4196-8157-7c71e81533e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:05:27.978235 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b221222-417d-4196-8157-7c71e81533e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:05:27.979643 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b221222-417d-4196-8157-7c71e81533e0 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:05:27.999436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 402/821] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Jul 28 11:05:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:05:37.830685 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=88 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:05:37.995115 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=28,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:29.756943 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92103fc-3b86-409c-94a6-e60a18fb046a None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:29.757484 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92103fc-3b86-409c-94a6-e60a18fb046a None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:29.757484 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92103fc-3b86-409c-94a6-e60a18fb046a None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:29.758908 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 420/822] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:06:29.765037 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f275b4-dc00-40a6-90d5-95a3ed8e13c4 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:29.765520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f275b4-dc00-40a6-90d5-95a3ed8e13c4 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:29.765823 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f275b4-dc00-40a6-90d5-95a3ed8e13c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:29.788163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-a3f275b4-dc00-40a6-90d5-95a3ed8e13c4 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:06:29.789371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-a3f275b4-dc00-40a6-90d5-95a3ed8e13c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:06:29.883974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 403/823] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:06:29 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 11:06:29.913906 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92103fc-3b86-409c-94a6-e60a18fb046a None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:30.048869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92103fc-3b86-409c-94a6-e60a18fb046a None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:30.093673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168d437-20c2-433b-9582-39400b2314e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:30.094341 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168d437-20c2-433b-9582-39400b2314e8 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:30.094632 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168d437-20c2-433b-9582-39400b2314e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:30.095019 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168d437-20c2-433b-9582-39400b2314e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:30.109754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168d437-20c2-433b-9582-39400b2314e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:30.111616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168d437-20c2-433b-9582-39400b2314e8 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:30.131888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-f168d437-20c2-433b-9582-39400b2314e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:30.131888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:30.131888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:30.131888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:30.131888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:30.131888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:30.131888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:30.131888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:30.131888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:30.131888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:30.131888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:30.131888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:30.131888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:06:30.131888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:06:30.131888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:06:30.133196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:06:30.133196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:30.133196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:30.133196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:30.133196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:30.133196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:30.133196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:30.133196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:30.133196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:30.133196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:30.133196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:30.133196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:30.133196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:30.133196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:30.133196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:30.133196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:30.133196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:30.139997 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:06:30.139997 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:06:30.139997 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:30.139997 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:06:30.139997 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 421/824] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:30.140378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f275b4-dc00-40a6-90d5-95a3ed8e13c4 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:30.261563 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f275b4-dc00-40a6-90d5-95a3ed8e13c4 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:30.296121 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:30.308858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66b38f-79d8-45fa-a452-1186edd4e47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:30.309716 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66b38f-79d8-45fa-a452-1186edd4e47e None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:30.310239 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66b38f-79d8-45fa-a452-1186edd4e47e None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:30.310731 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66b38f-79d8-45fa-a452-1186edd4e47e None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:30.311658 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66b38f-79d8-45fa-a452-1186edd4e47e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:30.311974 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66b38f-79d8-45fa-a452-1186edd4e47e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:30.313509 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66b38f-79d8-45fa-a452-1186edd4e47e None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:30.328989 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 404/825] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:30.335507 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168d437-20c2-433b-9582-39400b2314e8 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:30.395552 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:30.453954 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168d437-20c2-433b-9582-39400b2314e8 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:30.501090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9c29c-8b2c-48b9-91b3-be5d5b49b81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:30.501788 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9c29c-8b2c-48b9-91b3-be5d5b49b81f None admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:30.502073 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9c29c-8b2c-48b9-91b3-be5d5b49b81f None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:30.502352 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9c29c-8b2c-48b9-91b3-be5d5b49b81f None admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:30.503057 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9c29c-8b2c-48b9-91b3-be5d5b49b81f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:30.504670 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9c29c-8b2c-48b9-91b3-be5d5b49b81f None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:30.528743 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 422/826] 10.222.0.71 () {60 vars in 1132 bytes} [Thu Jul 28 11:06:30 2022] POST /identity/v3/users => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 11:06:33.118166 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ae8d8-eecb-4f88-bde6-5058c8b58873 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:33.118783 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ae8d8-eecb-4f88-bde6-5058c8b58873 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:33.118874 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ae8d8-eecb-4f88-bde6-5058c8b58873 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:33.120421 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 405/827] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:06:33.126063 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c8616-cdae-4262-8491-963db6f973cd None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:33.126562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c8616-cdae-4262-8491-963db6f973cd None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:33.126668 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c8616-cdae-4262-8491-963db6f973cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:33.149954 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-158c8616-cdae-4262-8491-963db6f973cd None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:06:33.151693 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-158c8616-cdae-4262-8491-963db6f973cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:06:33.233631 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 423/828] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:06:33 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 11:06:33.261387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ae8d8-eecb-4f88-bde6-5058c8b58873 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:33.393807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ae8d8-eecb-4f88-bde6-5058c8b58873 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:33.444516 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e106c6-5ce3-45ec-9ea2-57d008ad9809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:33.445198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e106c6-5ce3-45ec-9ea2-57d008ad9809 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:33.445547 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e106c6-5ce3-45ec-9ea2-57d008ad9809 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:33.445931 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e106c6-5ce3-45ec-9ea2-57d008ad9809 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:33.460639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e106c6-5ce3-45ec-9ea2-57d008ad9809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:06:33.466908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-61e106c6-5ce3-45ec-9ea2-57d008ad9809 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:06:33.466908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:33.466908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:33.466908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:33.466908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:33.466908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:33.466908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:33.466908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:33.466908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:33.466908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:33.466908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:33.466908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:33.466908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:06:33.466908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:06:33.466908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:06:33.466908 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:06:33.468118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:06:33.468118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:06:33.468118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:06:33.468118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:06:33.468118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:33.468118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:33.468118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:33.468118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:33.468118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:33.468118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:33.468118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:33.468118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:33.468118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:33.468118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:33.468118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:33.468118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:33.468942 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:33.468942 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:33.468942 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:33.468942 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:33.468942 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:06:33.468942 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:06:33.468942 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:06:33.468942 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:06:33.468942 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:06:33.468942 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:06:33.468942 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:06:33.468942 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:06:33.474030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 406/829] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Jul 28 11:06:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:33.476107 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c8616-cdae-4262-8491-963db6f973cd None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:33.524741 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:33.594341 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c8616-cdae-4262-8491-963db6f973cd None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:33.632808 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67601ab-3c0b-4760-8dd5-84efdc412c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:33.633441 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67601ab-3c0b-4760-8dd5-84efdc412c4d None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:33.633745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67601ab-3c0b-4760-8dd5-84efdc412c4d None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:33.634094 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67601ab-3c0b-4760-8dd5-84efdc412c4d None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:33.634826 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67601ab-3c0b-4760-8dd5-84efdc412c4d None admin] RBAC: Adding query filter params (name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:33.635161 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67601ab-3c0b-4760-8dd5-84efdc412c4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:33.636832 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67601ab-3c0b-4760-8dd5-84efdc412c4d None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:33.646390 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 424/830] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Jul 28 11:06:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:33.653396 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e106c6-5ce3-45ec-9ea2-57d008ad9809 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:33.717423 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:33.778255 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e106c6-5ce3-45ec-9ea2-57d008ad9809 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:33.816062 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41295b12-45d7-4fae-bf8c-1fe0c988f1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:33.816737 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41295b12-45d7-4fae-bf8c-1fe0c988f1a7 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:33.817021 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41295b12-45d7-4fae-bf8c-1fe0c988f1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:33.817351 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41295b12-45d7-4fae-bf8c-1fe0c988f1a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:33.829168 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41295b12-45d7-4fae-bf8c-1fe0c988f1a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:33.830663 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41295b12-45d7-4fae-bf8c-1fe0c988f1a7 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:33.846927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-41295b12-45d7-4fae-bf8c-1fe0c988f1a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:33.846927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:33.846927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:33.846927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:33.846927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:33.846927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:33.846927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:33.846927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:33.846927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:33.846927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:33.846927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:33.846927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:33.846927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:06:33.846927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:06:33.846927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:06:33.848389 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:06:33.848389 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:33.848389 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:33.848389 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:33.848389 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:33.848389 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:33.848389 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:33.848389 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:33.848389 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:33.848389 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:33.848389 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:33.848389 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:33.848389 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:33.848389 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:33.848389 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:33.848389 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:33.848389 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:33.849744 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:06:33.849744 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:06:33.849744 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:33.849744 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:06:33.852872 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 407/831] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:33.854329 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67601ab-3c0b-4760-8dd5-84efdc412c4d None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:33.961697 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:33.964895 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67601ab-3c0b-4760-8dd5-84efdc412c4d None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:34.005654 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ba33a-c329-41e4-babf-3fd4222b4dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:34.006821 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ba33a-c329-41e4-babf-3fd4222b4dbc None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:34.007103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ba33a-c329-41e4-babf-3fd4222b4dbc None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:34.007410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ba33a-c329-41e4-babf-3fd4222b4dbc None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:34.008421 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ba33a-c329-41e4-babf-3fd4222b4dbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:34.008728 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ba33a-c329-41e4-babf-3fd4222b4dbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:34.010116 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ba33a-c329-41e4-babf-3fd4222b4dbc None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:34.024679 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 425/832] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:06:34.031154 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41295b12-45d7-4fae-bf8c-1fe0c988f1a7 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:34.151654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:34.156183 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41295b12-45d7-4fae-bf8c-1fe0c988f1a7 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:34.199068 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e1523-aa9d-41b0-95ad-be3a4990180b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:34.199941 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e1523-aa9d-41b0-95ad-be3a4990180b None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:34.200308 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e1523-aa9d-41b0-95ad-be3a4990180b None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:34.200619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e1523-aa9d-41b0-95ad-be3a4990180b None admin] PATH_INFO: `/v3/users/placement` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:34.211460 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e1523-aa9d-41b0-95ad-be3a4990180b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:34.213265 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e1523-aa9d-41b0-95ad-be3a4990180b None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:34.237144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-b81e1523-aa9d-41b0-95ad-be3a4990180b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 11:06:34.237144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:34.237144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:34.237144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:34.237144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:34.237144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:34.237144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:34.237144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:34.237144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:34.237144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:34.237144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:34.237144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:34.237144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:06:34.237144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:06:34.237144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:06:34.237144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:06:34.238378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:34.238378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:34.238378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:06:34.238378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:06:34.238378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:06:34.238378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:06:34.238378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:34.238378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:34.238378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:34.238378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:34.238378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:34.238378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:34.238378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:34.238378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:34.238378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:34.238378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:34.238378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:34.238378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:34.239700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:34.239700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:34.239700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:06:34.239700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:06:34.239700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:06:34.239700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:06:34.239700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:06:34.239700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:06:34.239700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 11:06:34.239700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:06:34.239700 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 408/833] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:06:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:34.245312 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ba33a-c329-41e4-babf-3fd4222b4dbc None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:34.366191 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ba33a-c329-41e4-babf-3fd4222b4dbc None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:34.403669 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822147ee-f72c-454d-bce3-ec73fa192aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:34.404298 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822147ee-f72c-454d-bce3-ec73fa192aaa None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:34.404581 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822147ee-f72c-454d-bce3-ec73fa192aaa None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:34.404855 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822147ee-f72c-454d-bce3-ec73fa192aaa None admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:34.405649 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822147ee-f72c-454d-bce3-ec73fa192aaa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:34.405951 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822147ee-f72c-454d-bce3-ec73fa192aaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:34.407397 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822147ee-f72c-454d-bce3-ec73fa192aaa None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:34.426293 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 426/834] 10.222.0.71 () {56 vars in 1143 bytes} [Thu Jul 28 11:06:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:34.434012 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e1523-aa9d-41b0-95ad-be3a4990180b None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:34.552994 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e1523-aa9d-41b0-95ad-be3a4990180b None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:34.594971 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd44301-1413-4ce6-90fa-631f452eb1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:34.595615 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd44301-1413-4ce6-90fa-631f452eb1bd None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:34.595904 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd44301-1413-4ce6-90fa-631f452eb1bd None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:34.596182 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd44301-1413-4ce6-90fa-631f452eb1bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:34.627188 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:34.676315 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd44301-1413-4ce6-90fa-631f452eb1bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:34.678025 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd44301-1413-4ce6-90fa-631f452eb1bd None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:34.799464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 409/835] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:06:34 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 11:06:34.806312 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822147ee-f72c-454d-bce3-ec73fa192aaa None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:34.828176 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:34.923548 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822147ee-f72c-454d-bce3-ec73fa192aaa None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:34.961313 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdabd4-5a19-4655-8faa-b1604c989e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:34.962054 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdabd4-5a19-4655-8faa-b1604c989e02 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:34.962435 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdabd4-5a19-4655-8faa-b1604c989e02 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:34.962805 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdabd4-5a19-4655-8faa-b1604c989e02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:34.973933 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdabd4-5a19-4655-8faa-b1604c989e02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:34.975487 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdabd4-5a19-4655-8faa-b1604c989e02 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:34.990909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-6acdabd4-5a19-4655-8faa-b1604c989e02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:34.990909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:34.990909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:34.990909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:34.990909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:34.990909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:34.990909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:34.990909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:34.990909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:34.990909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:34.990909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:34.990909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:34.990909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:06:34.990909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:06:34.990909 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:06:34.992820 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:06:34.992820 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:34.992820 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:34.992820 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:34.992820 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:34.992820 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:34.992820 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:34.992820 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:34.992820 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:34.992820 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:34.992820 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:34.992820 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:34.992820 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:34.992820 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:34.992820 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:34.992820 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:34.992820 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:34.994825 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:06:34.994825 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:06:34.994825 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:34.994825 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:06:34.994825 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 427/836] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:35.000310 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd44301-1413-4ce6-90fa-631f452eb1bd None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:35.064759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:35.114865 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd44301-1413-4ce6-90fa-631f452eb1bd None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:35.154992 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c243b-ccb1-4fb3-96bc-0756c0f48d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:35.155788 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c243b-ccb1-4fb3-96bc-0756c0f48d9d None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:35.156211 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c243b-ccb1-4fb3-96bc-0756c0f48d9d None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:35.156488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c243b-ccb1-4fb3-96bc-0756c0f48d9d None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:35.157332 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c243b-ccb1-4fb3-96bc-0756c0f48d9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:35.157658 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c243b-ccb1-4fb3-96bc-0756c0f48d9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:35.159234 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c243b-ccb1-4fb3-96bc-0756c0f48d9d None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:35.173859 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 410/837] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:35.179972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdabd4-5a19-4655-8faa-b1604c989e02 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:35.266591 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:35.306012 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdabd4-5a19-4655-8faa-b1604c989e02 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:35.348547 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1c557-38f5-4402-8e3f-f566970625ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:35.348990 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1c557-38f5-4402-8e3f-f566970625ef None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:35.349270 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1c557-38f5-4402-8e3f-f566970625ef None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:35.349549 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1c557-38f5-4402-8e3f-f566970625ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:35.356764 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1c557-38f5-4402-8e3f-f566970625ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:35.358265 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1c557-38f5-4402-8e3f-f566970625ef None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:35.370735 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-e0b1c557-38f5-4402-8e3f-f566970625ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:06:35.370735 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:35.370735 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:35.370735 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:35.370735 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:35.370735 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:35.370735 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:35.370735 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:35.370735 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:35.370735 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:35.370735 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:35.370735 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:35.370735 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:06:35.370735 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:06:35.370735 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:06:35.376905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:06:35.376905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:35.376905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:35.376905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:35.376905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:35.376905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:35.376905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:35.376905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:35.376905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:35.376905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:35.376905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:35.376905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:35.376905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:35.376905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:35.376905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:35.376905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:35.376905 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:35.378564 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:06:35.378564 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:06:35.378564 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:06:35.378564 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:06:35.378564 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:06:35.378564 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:06:35.378564 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:06:35.378564 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:06:35.378564 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 428/838] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:06:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:35.379668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c243b-ccb1-4fb3-96bc-0756c0f48d9d None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:35.508323 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c243b-ccb1-4fb3-96bc-0756c0f48d9d None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:35.530444 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:35.559151 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708b86f-c80c-45fb-af03-5d3fbc0ad4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:35.560274 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708b86f-c80c-45fb-af03-5d3fbc0ad4f3 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:35.560781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708b86f-c80c-45fb-af03-5d3fbc0ad4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:35.561278 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708b86f-c80c-45fb-af03-5d3fbc0ad4f3 None admin] PATH_INFO: `/v3/projects` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:35.562737 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708b86f-c80c-45fb-af03-5d3fbc0ad4f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:35.563321 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708b86f-c80c-45fb-af03-5d3fbc0ad4f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:35.566085 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708b86f-c80c-45fb-af03-5d3fbc0ad4f3 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:35.591621 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 411/839] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:06:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:35.598822 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1c557-38f5-4402-8e3f-f566970625ef None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:35.720730 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1c557-38f5-4402-8e3f-f566970625ef None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:35.752121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:35.761748 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d55aeb-0d45-4eea-afab-5850fb042639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:35.762390 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d55aeb-0d45-4eea-afab-5850fb042639 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:35.762679 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d55aeb-0d45-4eea-afab-5850fb042639 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:35.762960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d55aeb-0d45-4eea-afab-5850fb042639 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:35.764069 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d55aeb-0d45-4eea-afab-5850fb042639 None admin] RBAC: Adding query filter params (role.id=2889c6a70cf04dfda4618a8374822c11, scope.project.id=11f4749185bf4adba9ae3cf927b6880b, user.id=8f4cb7d2680d4eb99a7328a54fcfd351) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:35.764484 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d55aeb-0d45-4eea-afab-5850fb042639 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:35.766288 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d55aeb-0d45-4eea-afab-5850fb042639 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:35.772622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 429/840] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:06:35 2022] GET /identity/v3/role_assignments?user.id=8f4cb7d2680d4eb99a7328a54fcfd351&scope.project.id=11f4749185bf4adba9ae3cf927b6880b&role.id=2889c6a70cf04dfda4618a8374822c11 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:38.255606 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008d097-fc4e-4c62-959e-c9f01c66d93f None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:38.256823 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008d097-fc4e-4c62-959e-c9f01c66d93f None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:38.256823 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008d097-fc4e-4c62-959e-c9f01c66d93f None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:38.258195 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 412/841] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:06:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:06:38.265211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048053f-523e-4f1b-9752-cc341d0bd918 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:38.265713 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048053f-523e-4f1b-9752-cc341d0bd918 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:38.265983 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048053f-523e-4f1b-9752-cc341d0bd918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:38.291098 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-9048053f-523e-4f1b-9752-cc341d0bd918 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:06:38.292634 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-9048053f-523e-4f1b-9752-cc341d0bd918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:06:38.392957 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 430/842] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:06:38 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:06:38.417901 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008d097-fc4e-4c62-959e-c9f01c66d93f None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:38.546343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008d097-fc4e-4c62-959e-c9f01c66d93f None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:38.585366 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6572560-ce47-4c04-9ca2-3001bc5f040f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:38.586109 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6572560-ce47-4c04-9ca2-3001bc5f040f None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:38.586400 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6572560-ce47-4c04-9ca2-3001bc5f040f None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:38.586747 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6572560-ce47-4c04-9ca2-3001bc5f040f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:38.598407 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6572560-ce47-4c04-9ca2-3001bc5f040f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:06:38.604049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-e6572560-ce47-4c04-9ca2-3001bc5f040f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:06:38.604049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:38.604049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:38.604049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:38.604049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:38.604049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:38.604049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:38.604049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:38.604049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:38.604049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:38.604049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:38.604049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:38.604049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:06:38.604049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:06:38.604049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:06:38.604049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:06:38.605388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:06:38.605388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:06:38.605388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:06:38.605388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:06:38.605388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:38.605388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:38.605388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:38.605388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:38.605388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:38.605388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:38.605388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:38.605388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:38.605388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:38.605388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:38.605388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:38.605388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:38.606316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:38.606316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:38.606316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:38.606316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:38.606316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:06:38.606316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:06:38.606316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:06:38.606316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:06:38.606316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:06:38.606316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:06:38.606316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:06:38.606316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:06:38.606316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 413/843] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Jul 28 11:06:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:38.611984 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048053f-523e-4f1b-9752-cc341d0bd918 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:38.732280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048053f-523e-4f1b-9752-cc341d0bd918 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:38.762049 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:38.775666 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68e273-60c2-47f3-b70e-ddcfbd7b7bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:38.776607 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68e273-60c2-47f3-b70e-ddcfbd7b7bf6 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:38.776989 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68e273-60c2-47f3-b70e-ddcfbd7b7bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:38.777363 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68e273-60c2-47f3-b70e-ddcfbd7b7bf6 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:38.778219 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68e273-60c2-47f3-b70e-ddcfbd7b7bf6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:38.778677 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68e273-60c2-47f3-b70e-ddcfbd7b7bf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:38.780406 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68e273-60c2-47f3-b70e-ddcfbd7b7bf6 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:38.788995 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 431/844] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Jul 28 11:06:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:38.794721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6572560-ce47-4c04-9ca2-3001bc5f040f None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:38.845224 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:38.919972 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6572560-ce47-4c04-9ca2-3001bc5f040f None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:38.959672 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25ec6b-409a-4cfe-bf06-c7cab964ee84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:38.960347 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25ec6b-409a-4cfe-bf06-c7cab964ee84 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:38.960855 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25ec6b-409a-4cfe-bf06-c7cab964ee84 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:38.960988 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25ec6b-409a-4cfe-bf06-c7cab964ee84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:38.972173 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25ec6b-409a-4cfe-bf06-c7cab964ee84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:38.973813 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25ec6b-409a-4cfe-bf06-c7cab964ee84 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:38.989808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-5b25ec6b-409a-4cfe-bf06-c7cab964ee84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:38.989808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:38.989808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:38.989808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:38.989808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:38.989808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:38.989808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:38.989808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:38.989808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:38.989808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:38.989808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:38.989808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:38.989808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:06:38.989808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:06:38.989808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:06:38.991660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:06:38.991660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:38.991660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:38.991660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:38.991660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:38.991660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:38.991660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:38.991660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:38.991660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:38.991660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:38.991660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:38.991660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:38.991660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:38.991660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:38.991660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:38.991660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:38.991660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:38.993620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:06:38.993620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:06:38.993620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:38.993620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:06:38.993620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 414/845] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:06:38.997975 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68e273-60c2-47f3-b70e-ddcfbd7b7bf6 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:39.117209 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68e273-60c2-47f3-b70e-ddcfbd7b7bf6 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:39.170092 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f53b40-c394-4f4e-9ba3-6096c2e99d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:39.171000 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f53b40-c394-4f4e-9ba3-6096c2e99d61 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:39.171331 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f53b40-c394-4f4e-9ba3-6096c2e99d61 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:39.171869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f53b40-c394-4f4e-9ba3-6096c2e99d61 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:39.172900 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f53b40-c394-4f4e-9ba3-6096c2e99d61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:39.173277 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f53b40-c394-4f4e-9ba3-6096c2e99d61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:39.175418 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f53b40-c394-4f4e-9ba3-6096c2e99d61 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:39.192861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 432/846] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:06:39.198779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25ec6b-409a-4cfe-bf06-c7cab964ee84 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:39.305935 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:39.318771 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25ec6b-409a-4cfe-bf06-c7cab964ee84 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:39.359640 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61654e4d-0abd-4156-8b8f-e7404d8e0b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:39.360341 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654e4d-0abd-4156-8b8f-e7404d8e0b7e None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:39.360688 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654e4d-0abd-4156-8b8f-e7404d8e0b7e None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:39.361011 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654e4d-0abd-4156-8b8f-e7404d8e0b7e None admin] PATH_INFO: `/v3/users/placement` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:39.372712 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61654e4d-0abd-4156-8b8f-e7404d8e0b7e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:39.374230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61654e4d-0abd-4156-8b8f-e7404d8e0b7e None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:39.387954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-61654e4d-0abd-4156-8b8f-e7404d8e0b7e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 11:06:39.387954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:39.387954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:39.387954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:39.387954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:39.387954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:39.387954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:39.387954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:39.387954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:39.387954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:39.387954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:39.387954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:39.387954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:06:39.387954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:06:39.387954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:06:39.387954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:06:39.395443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:39.395443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:39.395443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:06:39.395443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:06:39.395443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:06:39.395443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:06:39.395443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:39.395443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:39.395443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:39.395443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:39.395443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:39.395443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:39.395443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:39.395443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:39.395443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:39.395443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:39.395443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:39.395443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:39.396581 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:39.396581 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:39.396581 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:06:39.396581 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:06:39.396581 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:06:39.396581 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:06:39.396581 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:06:39.396581 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:06:39.396581 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 11:06:39.396581 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:06:39.396581 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 415/847] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:06:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:39.397405 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f53b40-c394-4f4e-9ba3-6096c2e99d61 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:39.457490 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:39.544021 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f53b40-c394-4f4e-9ba3-6096c2e99d61 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:39.588263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dc3ea-ce77-47c7-8891-453894cb8227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:39.589150 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dc3ea-ce77-47c7-8891-453894cb8227 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:39.589408 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dc3ea-ce77-47c7-8891-453894cb8227 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:39.589691 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dc3ea-ce77-47c7-8891-453894cb8227 None admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:39.590603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686dc3ea-ce77-47c7-8891-453894cb8227 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:39.591006 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686dc3ea-ce77-47c7-8891-453894cb8227 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:39.592798 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686dc3ea-ce77-47c7-8891-453894cb8227 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:39.612741 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 433/848] 10.222.0.71 () {56 vars in 1143 bytes} [Thu Jul 28 11:06:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:39.619158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61654e4d-0abd-4156-8b8f-e7404d8e0b7e None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:39.739981 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61654e4d-0abd-4156-8b8f-e7404d8e0b7e None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:39.793188 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7d2f3-a07e-4b1d-9a4c-c19e5c18a654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:39.794067 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7d2f3-a07e-4b1d-9a4c-c19e5c18a654 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:39.794400 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7d2f3-a07e-4b1d-9a4c-c19e5c18a654 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:39.794730 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7d2f3-a07e-4b1d-9a4c-c19e5c18a654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:39.807042 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7d2f3-a07e-4b1d-9a4c-c19e5c18a654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:39.808731 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7d2f3-a07e-4b1d-9a4c-c19e5c18a654 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:39.825525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-38b7d2f3-a07e-4b1d-9a4c-c19e5c18a654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:39.825525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:39.825525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:39.825525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:39.825525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:39.825525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:39.825525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:39.825525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:39.825525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:39.825525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:39.825525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:39.825525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:39.825525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:06:39.825525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:06:39.825525 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:06:39.826746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:06:39.826746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:39.826746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:39.826746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:39.826746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:39.826746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:39.826746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:39.826746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:39.826746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:39.826746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:39.826746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:39.826746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:39.826746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:39.826746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:39.826746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:39.826746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:39.826746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:39.827655 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:06:39.827655 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:06:39.827655 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:39.827655 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:06:39.827655 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 416/849] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:06:39.833303 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dc3ea-ce77-47c7-8891-453894cb8227 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:39.950313 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dc3ea-ce77-47c7-8891-453894cb8227 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:39.952692 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:39.987787 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4d78e-1d9b-4033-8064-af5238b2c9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:39.988444 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4d78e-1d9b-4033-8064-af5238b2c9f3 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:39.988736 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4d78e-1d9b-4033-8064-af5238b2c9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:39.989055 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4d78e-1d9b-4033-8064-af5238b2c9f3 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:39.989929 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4d78e-1d9b-4033-8064-af5238b2c9f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:39.990350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4d78e-1d9b-4033-8064-af5238b2c9f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:39.991776 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4d78e-1d9b-4033-8064-af5238b2c9f3 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:40.004353 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 434/850] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:40.010669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7d2f3-a07e-4b1d-9a4c-c19e5c18a654 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:40.013911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:40.121665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7d2f3-a07e-4b1d-9a4c-c19e5c18a654 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:40.159784 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2eca2-e7b6-4cf5-9849-55099ecfc316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:40.160433 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2eca2-e7b6-4cf5-9849-55099ecfc316 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:40.160717 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2eca2-e7b6-4cf5-9849-55099ecfc316 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:40.160995 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2eca2-e7b6-4cf5-9849-55099ecfc316 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:40.168518 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2eca2-e7b6-4cf5-9849-55099ecfc316 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:40.170208 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2eca2-e7b6-4cf5-9849-55099ecfc316 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:40.182749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-29e2eca2-e7b6-4cf5-9849-55099ecfc316 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:06:40.182749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:40.182749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:40.182749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:40.182749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:40.182749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:40.182749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:40.182749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:40.182749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:40.182749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:40.182749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:40.182749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:40.182749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:06:40.182749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:06:40.182749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:06:40.183779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:06:40.183779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:40.183779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:40.183779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:40.183779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:40.183779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:40.183779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:40.183779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:40.183779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:40.183779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:40.183779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:40.183779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:40.183779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:40.183779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:40.183779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:40.183779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:40.183779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:40.184743 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:06:40.184743 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:06:40.184743 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:06:40.184743 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:06:40.184743 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:06:40.184743 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:06:40.184743 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:06:40.184743 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:06:40.184743 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 417/851] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:06:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:40.189971 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4d78e-1d9b-4033-8064-af5238b2c9f3 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:40.301320 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4d78e-1d9b-4033-8064-af5238b2c9f3 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:40.344772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cafb2-a82a-4d6c-9159-fd61c5ea258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:40.345685 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cafb2-a82a-4d6c-9159-fd61c5ea258a None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:40.345989 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cafb2-a82a-4d6c-9159-fd61c5ea258a None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:40.346278 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cafb2-a82a-4d6c-9159-fd61c5ea258a None admin] PATH_INFO: `/v3/projects` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:40.347243 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cafb2-a82a-4d6c-9159-fd61c5ea258a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:40.347596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cafb2-a82a-4d6c-9159-fd61c5ea258a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:40.349087 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cafb2-a82a-4d6c-9159-fd61c5ea258a None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:40.367139 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 435/852] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:06:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:40.373694 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2eca2-e7b6-4cf5-9849-55099ecfc316 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:40.446028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:40.502436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2eca2-e7b6-4cf5-9849-55099ecfc316 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:40.547446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995afa6-8c31-4e00-91c0-ce17d62af416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:40.548130 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995afa6-8c31-4e00-91c0-ce17d62af416 None admin] REQUEST_METHOD: `PUT` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:40.548418 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995afa6-8c31-4e00-91c0-ce17d62af416 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:40.548697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995afa6-8c31-4e00-91c0-ce17d62af416 None admin] PATH_INFO: `/v3/projects/11f4749185bf4adba9ae3cf927b6880b/users/8f4cb7d2680d4eb99a7328a54fcfd351/roles/2889c6a70cf04dfda4618a8374822c11` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:40.565564 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995afa6-8c31-4e00-91c0-ce17d62af416 None admin] RBAC: Authorizing `identity:create_grant(project_id=11f4749185bf4adba9ae3cf927b6880b, user_id=8f4cb7d2680d4eb99a7328a54fcfd351, role_id=2889c6a70cf04dfda4618a8374822c11)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:40.566956 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995afa6-8c31-4e00-91c0-ce17d62af416 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:40.581870 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 418/853] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Jul 28 11:06:40 2022] PUT /identity/v3/projects/11f4749185bf4adba9ae3cf927b6880b/users/8f4cb7d2680d4eb99a7328a54fcfd351/roles/2889c6a70cf04dfda4618a8374822c11 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:06:42.847216 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c48bbc-d436-4a58-bae2-e73b98f405d0 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:42.847842 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c48bbc-d436-4a58-bae2-e73b98f405d0 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:42.847842 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c48bbc-d436-4a58-bae2-e73b98f405d0 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:42.849192 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 436/854] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:06:42.855641 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d7019-cb89-4e54-ad6b-c9dd9fc2b16b None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:42.856198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d7019-cb89-4e54-ad6b-c9dd9fc2b16b None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:42.856198 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d7019-cb89-4e54-ad6b-c9dd9fc2b16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:42.876609 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-fc3d7019-cb89-4e54-ad6b-c9dd9fc2b16b None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:06:42.878033 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-fc3d7019-cb89-4e54-ad6b-c9dd9fc2b16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:06:42.955710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 419/855] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:06:42 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:06:42.980578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c48bbc-d436-4a58-bae2-e73b98f405d0 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:43.009571 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:43.090273 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c48bbc-d436-4a58-bae2-e73b98f405d0 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:43.128271 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e00c90-eccf-4078-a394-d2d9fdee49db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:43.128838 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e00c90-eccf-4078-a394-d2d9fdee49db None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:43.129118 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e00c90-eccf-4078-a394-d2d9fdee49db None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:43.129393 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e00c90-eccf-4078-a394-d2d9fdee49db None admin] PATH_INFO: `/v3/roles/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:43.141141 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e00c90-eccf-4078-a394-d2d9fdee49db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:06:43.147829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-10e00c90-eccf-4078-a394-d2d9fdee49db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:06:43.147829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:43.147829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:43.147829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:43.147829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:43.147829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:43.147829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:43.147829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:43.147829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:43.147829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:43.147829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:43.147829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:43.147829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:06:43.147829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:06:43.147829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:06:43.147829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:06:43.149410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:06:43.149410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:06:43.149410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:06:43.149410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:06:43.149410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:43.149410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:43.149410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:43.149410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:43.149410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:43.149410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:43.149410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:43.149410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:43.149410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:43.149410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:43.149410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:43.149410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:43.150260 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:43.150260 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:43.150260 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:43.150260 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:43.150260 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:06:43.150260 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:06:43.150260 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:06:43.150260 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:06:43.150260 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:06:43.150260 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:06:43.150260 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 11:06:43.150260 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:06:43.150260 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 437/856] 10.222.0.71 () {56 vars in 1102 bytes} [Thu Jul 28 11:06:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:43.155769 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d7019-cb89-4e54-ad6b-c9dd9fc2b16b None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:43.206277 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:43.277400 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d7019-cb89-4e54-ad6b-c9dd9fc2b16b None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:43.314547 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319da3e5-a4dc-4e1a-a578-4a5bf0026754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:43.315235 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319da3e5-a4dc-4e1a-a578-4a5bf0026754 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:43.315581 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319da3e5-a4dc-4e1a-a578-4a5bf0026754 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:43.315902 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319da3e5-a4dc-4e1a-a578-4a5bf0026754 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:43.316669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319da3e5-a4dc-4e1a-a578-4a5bf0026754 None admin] RBAC: Adding query filter params (name=service) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:43.317016 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319da3e5-a4dc-4e1a-a578-4a5bf0026754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:43.318596 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319da3e5-a4dc-4e1a-a578-4a5bf0026754 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:43.327657 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 420/857] 10.222.0.71 () {56 vars in 1103 bytes} [Thu Jul 28 11:06:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:06:43.333585 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e00c90-eccf-4078-a394-d2d9fdee49db None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:43.441655 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:43.460377 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e00c90-eccf-4078-a394-d2d9fdee49db None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:43.507273 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27588eba-8d49-4825-84ae-10e12655d68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:43.508132 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27588eba-8d49-4825-84ae-10e12655d68d None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:43.508589 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27588eba-8d49-4825-84ae-10e12655d68d None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:43.508927 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27588eba-8d49-4825-84ae-10e12655d68d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:43.526250 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27588eba-8d49-4825-84ae-10e12655d68d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:43.528762 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27588eba-8d49-4825-84ae-10e12655d68d None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:43.556325 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-27588eba-8d49-4825-84ae-10e12655d68d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:43.556325 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:43.556325 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:43.556325 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:43.556325 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:43.556325 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:43.556325 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:43.556325 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:43.556325 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:43.556325 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:43.556325 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:43.556325 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:43.556325 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:06:43.556325 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:06:43.556325 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:06:43.557468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:06:43.557468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:43.557468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:43.557468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:43.557468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:43.557468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:43.557468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:43.557468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:43.557468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:43.557468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:43.557468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:43.557468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:43.557468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:43.557468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:43.557468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:43.557468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:43.557468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:43.558466 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:06:43.558466 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:06:43.558466 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:43.558466 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:06:43.558466 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 438/858] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:43.564697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319da3e5-a4dc-4e1a-a578-4a5bf0026754 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:43.671505 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319da3e5-a4dc-4e1a-a578-4a5bf0026754 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:43.673946 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:43.708834 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9b456-ee55-419f-8319-fb574d08e186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:43.709932 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9b456-ee55-419f-8319-fb574d08e186 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:43.710273 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9b456-ee55-419f-8319-fb574d08e186 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:43.710520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9b456-ee55-419f-8319-fb574d08e186 None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:43.711184 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9b456-ee55-419f-8319-fb574d08e186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:43.711537 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9b456-ee55-419f-8319-fb574d08e186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:43.712948 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9b456-ee55-419f-8319-fb574d08e186 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:43.725178 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 421/859] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:43.731436 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27588eba-8d49-4825-84ae-10e12655d68d None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:43.848347 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27588eba-8d49-4825-84ae-10e12655d68d None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:43.903053 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f6eaa-4822-4a2d-926e-712186d021e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:43.903841 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f6eaa-4822-4a2d-926e-712186d021e1 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:43.904136 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f6eaa-4822-4a2d-926e-712186d021e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:43.904447 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f6eaa-4822-4a2d-926e-712186d021e1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:43.908583 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:43.916501 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f6eaa-4822-4a2d-926e-712186d021e1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:43.917970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f6eaa-4822-4a2d-926e-712186d021e1 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:43.930754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-575f6eaa-4822-4a2d-926e-712186d021e1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 11:06:43.930754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:43.930754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:43.930754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:43.930754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:43.930754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:43.930754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:43.930754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:43.930754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:43.930754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:43.930754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:43.930754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:43.930754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:06:43.930754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:06:43.930754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:06:43.930754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:06:43.932208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:43.932208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:43.932208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:06:43.932208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:06:43.932208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:06:43.932208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:06:43.932208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:43.932208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:43.932208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:43.932208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:43.932208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:43.932208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:43.932208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:43.932208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:43.932208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:43.932208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:43.932208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:43.932208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:43.933485 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:43.933485 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:43.933485 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:06:43.933485 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:06:43.933485 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:06:43.933485 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:06:43.933485 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:06:43.933485 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:06:43.933485 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 11:06:43.933485 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:06:43.933485 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 439/860] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:06:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:43.938096 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9b456-ee55-419f-8319-fb574d08e186 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:44.043586 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9b456-ee55-419f-8319-fb574d08e186 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:44.083870 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e30ce-2067-489c-8320-742649b53df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:44.084520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e30ce-2067-489c-8320-742649b53df2 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:44.084807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e30ce-2067-489c-8320-742649b53df2 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:44.085145 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e30ce-2067-489c-8320-742649b53df2 None admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:44.085877 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e30ce-2067-489c-8320-742649b53df2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:44.086194 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e30ce-2067-489c-8320-742649b53df2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:44.087707 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e30ce-2067-489c-8320-742649b53df2 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:44.106407 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 422/861] 10.222.0.71 () {56 vars in 1143 bytes} [Thu Jul 28 11:06:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:44.112516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f6eaa-4822-4a2d-926e-712186d021e1 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:44.223882 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f6eaa-4822-4a2d-926e-712186d021e1 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:44.262500 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c5a2c-2f8a-405e-83ed-3a56b4aa8021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:44.263146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c5a2c-2f8a-405e-83ed-3a56b4aa8021 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:44.263786 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c5a2c-2f8a-405e-83ed-3a56b4aa8021 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:44.264255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c5a2c-2f8a-405e-83ed-3a56b4aa8021 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:44.331302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:44.338891 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c5a2c-2f8a-405e-83ed-3a56b4aa8021 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:44.340648 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c5a2c-2f8a-405e-83ed-3a56b4aa8021 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:44.452703 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 440/862] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:06:44 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 11:06:44.459037 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e30ce-2067-489c-8320-742649b53df2 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:44.490467 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:44.584681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e30ce-2067-489c-8320-742649b53df2 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:44.621181 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ac526-4157-4801-a0da-00ceca30ffc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:44.621932 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ac526-4157-4801-a0da-00ceca30ffc4 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:44.622212 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ac526-4157-4801-a0da-00ceca30ffc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:44.622505 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ac526-4157-4801-a0da-00ceca30ffc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:44.634367 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ac526-4157-4801-a0da-00ceca30ffc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:44.635952 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ac526-4157-4801-a0da-00ceca30ffc4 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:44.653049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-1a4ac526-4157-4801-a0da-00ceca30ffc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:44.653049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:44.653049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:44.653049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:44.653049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:44.653049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:44.653049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:44.653049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:44.653049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:44.653049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:44.653049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:44.653049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:44.653049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:06:44.653049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:06:44.653049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:06:44.654081 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:06:44.654081 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:44.654081 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:44.654081 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:44.654081 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:44.654081 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:44.654081 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:44.654081 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:44.654081 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:44.654081 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:44.654081 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:44.654081 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:44.654081 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:44.654081 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:44.654081 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:44.654081 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:44.654081 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:44.655009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:06:44.655009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:06:44.655009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:44.655009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:06:44.655009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 423/863] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:44.660342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c5a2c-2f8a-405e-83ed-3a56b4aa8021 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:44.762656 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:44.770245 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c5a2c-2f8a-405e-83ed-3a56b4aa8021 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:44.809115 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74684ac1-a35b-46a5-a690-f547860b8861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:44.809742 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74684ac1-a35b-46a5-a690-f547860b8861 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:44.810033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74684ac1-a35b-46a5-a690-f547860b8861 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:44.810315 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74684ac1-a35b-46a5-a690-f547860b8861 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:44.811010 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74684ac1-a35b-46a5-a690-f547860b8861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:44.811346 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74684ac1-a35b-46a5-a690-f547860b8861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:44.812724 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74684ac1-a35b-46a5-a690-f547860b8861 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:44.824359 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 441/864] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:44.829914 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ac526-4157-4801-a0da-00ceca30ffc4 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:44.923883 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:44.959233 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ac526-4157-4801-a0da-00ceca30ffc4 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:45.001614 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a13c0-cb0f-4b74-b092-684c9713dfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:45.002251 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a13c0-cb0f-4b74-b092-684c9713dfbc None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:45.002725 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a13c0-cb0f-4b74-b092-684c9713dfbc None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:45.003018 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a13c0-cb0f-4b74-b092-684c9713dfbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:45.012780 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a13c0-cb0f-4b74-b092-684c9713dfbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:45.015682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a13c0-cb0f-4b74-b092-684c9713dfbc None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:45.029026 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-a91a13c0-cb0f-4b74-b092-684c9713dfbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:06:45.029026 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:45.029026 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:45.029026 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:45.029026 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:45.029026 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:45.029026 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:45.029026 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:45.029026 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:45.029026 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:45.029026 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:45.029026 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:45.029026 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:06:45.029026 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:06:45.029026 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:06:45.030158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:06:45.030158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:45.030158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:45.030158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:45.030158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:45.030158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:45.030158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:45.030158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:45.030158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:45.030158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:45.030158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:45.030158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:45.030158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:45.030158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:45.030158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:45.030158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:45.030158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:45.031403 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:06:45.031403 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:06:45.031403 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:06:45.031403 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:06:45.031403 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:06:45.031403 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:06:45.031403 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:06:45.031403 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:06:45.031403 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 424/865] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:06:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:45.036687 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74684ac1-a35b-46a5-a690-f547860b8861 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:45.158214 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74684ac1-a35b-46a5-a690-f547860b8861 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:45.198241 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9448f88-6907-4e20-824a-9ac173ab62e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:45.198879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9448f88-6907-4e20-824a-9ac173ab62e1 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:45.199346 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9448f88-6907-4e20-824a-9ac173ab62e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:45.199834 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9448f88-6907-4e20-824a-9ac173ab62e1 None admin] PATH_INFO: `/v3/projects` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:45.200869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9448f88-6907-4e20-824a-9ac173ab62e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:45.201183 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9448f88-6907-4e20-824a-9ac173ab62e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:45.202790 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9448f88-6907-4e20-824a-9ac173ab62e1 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:45.217562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 442/866] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:06:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:45.224084 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a13c0-cb0f-4b74-b092-684c9713dfbc None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:45.335830 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a13c0-cb0f-4b74-b092-684c9713dfbc None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:45.373279 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c37817-004b-4441-877a-98ec43e7b1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:45.374002 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c37817-004b-4441-877a-98ec43e7b1cb None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:45.374336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c37817-004b-4441-877a-98ec43e7b1cb None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:45.374570 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c37817-004b-4441-877a-98ec43e7b1cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:45.375524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c37817-004b-4441-877a-98ec43e7b1cb None admin] RBAC: Adding query filter params (role.id=2889c6a70cf04dfda4618a8374822c11, scope.project.id=11f4749185bf4adba9ae3cf927b6880b, user.id=8f4cb7d2680d4eb99a7328a54fcfd351) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:45.375800 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c37817-004b-4441-877a-98ec43e7b1cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:45.377272 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c37817-004b-4441-877a-98ec43e7b1cb None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:45.380565 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:45.386751 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 425/867] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:06:45 2022] GET /identity/v3/role_assignments?user.id=8f4cb7d2680d4eb99a7328a54fcfd351&scope.project.id=11f4749185bf4adba9ae3cf927b6880b&role.id=2889c6a70cf04dfda4618a8374822c11 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:48.176688 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6bb45-074e-463b-b4ab-3d2f7b430a12 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:48.177269 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6bb45-074e-463b-b4ab-3d2f7b430a12 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:48.177621 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6bb45-074e-463b-b4ab-3d2f7b430a12 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:48.180398 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 443/868] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:06:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:06:48.188563 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278c3c0-c5e7-4126-b814-9df136663715 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:48.189051 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278c3c0-c5e7-4126-b814-9df136663715 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:48.189127 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278c3c0-c5e7-4126-b814-9df136663715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:48.208288 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-0278c3c0-c5e7-4126-b814-9df136663715 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:06:48.210135 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-0278c3c0-c5e7-4126-b814-9df136663715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:06:48.285164 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 426/869] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:06:48 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:06:48.316019 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6bb45-074e-463b-b4ab-3d2f7b430a12 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:48.336006 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:48.457713 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6bb45-074e-463b-b4ab-3d2f7b430a12 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:48.509728 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f7782-7b76-484b-b7fa-7f77a0f8e6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:48.510389 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f7782-7b76-484b-b7fa-7f77a0f8e6f4 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:48.510716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f7782-7b76-484b-b7fa-7f77a0f8e6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:48.510959 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f7782-7b76-484b-b7fa-7f77a0f8e6f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:48.523867 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f7782-7b76-484b-b7fa-7f77a0f8e6f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:06:48.528879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-fc0f7782-7b76-484b-b7fa-7f77a0f8e6f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:06:48.528879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:48.528879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:48.528879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:48.528879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:48.528879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:48.528879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:48.528879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:48.528879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:48.528879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:48.528879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:48.528879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:48.528879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:06:48.528879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:06:48.528879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:06:48.528879 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:06:48.529960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:06:48.529960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:06:48.529960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:06:48.529960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:06:48.529960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:48.529960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:48.529960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:48.529960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:48.529960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:48.529960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:48.529960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:48.529960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:48.529960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:48.529960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:48.529960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:48.529960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:48.535970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:48.535970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:48.535970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:48.535970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:48.535970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:06:48.535970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:06:48.535970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:06:48.535970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:06:48.535970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:06:48.535970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:06:48.535970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:06:48.535970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:06:48.535970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 444/870] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Jul 28 11:06:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:48.536668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278c3c0-c5e7-4126-b814-9df136663715 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:48.646347 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278c3c0-c5e7-4126-b814-9df136663715 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:48.675879 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:48.685189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba7a6a-e5fd-4eff-b307-5af08cd7d694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:48.685979 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba7a6a-e5fd-4eff-b307-5af08cd7d694 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:48.686260 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba7a6a-e5fd-4eff-b307-5af08cd7d694 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:48.686624 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba7a6a-e5fd-4eff-b307-5af08cd7d694 None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:48.687679 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba7a6a-e5fd-4eff-b307-5af08cd7d694 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:48.688014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba7a6a-e5fd-4eff-b307-5af08cd7d694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:48.689602 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba7a6a-e5fd-4eff-b307-5af08cd7d694 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:48.699550 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 427/871] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:06:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:06:48.705812 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f7782-7b76-484b-b7fa-7f77a0f8e6f4 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:48.800244 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:48.835084 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f7782-7b76-484b-b7fa-7f77a0f8e6f4 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:48.876831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd10246-d206-4de3-a9af-1bf3fd6d8b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:48.877542 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd10246-d206-4de3-a9af-1bf3fd6d8b97 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:48.877859 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd10246-d206-4de3-a9af-1bf3fd6d8b97 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:48.878109 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd10246-d206-4de3-a9af-1bf3fd6d8b97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:48.891292 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd10246-d206-4de3-a9af-1bf3fd6d8b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:48.892768 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd10246-d206-4de3-a9af-1bf3fd6d8b97 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:48.910522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-3fd10246-d206-4de3-a9af-1bf3fd6d8b97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:48.910522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:48.910522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:48.910522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:48.910522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:48.910522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:48.910522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:48.910522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:48.910522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:48.910522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:48.910522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:48.910522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:48.910522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:06:48.910522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:06:48.910522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:06:48.911982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:06:48.911982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:48.911982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:48.911982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:48.911982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:48.911982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:48.911982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:48.911982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:48.911982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:48.911982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:48.911982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:48.911982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:48.911982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:48.911982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:48.911982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:48.911982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:48.911982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:48.912889 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:06:48.912889 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:06:48.912889 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:48.912889 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:06:48.912889 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 445/872] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:06:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:48.918033 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba7a6a-e5fd-4eff-b307-5af08cd7d694 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:49.030350 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba7a6a-e5fd-4eff-b307-5af08cd7d694 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:49.069787 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac96b72-fe8b-4abc-87f2-6dd768fad30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:49.070405 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac96b72-fe8b-4abc-87f2-6dd768fad30e None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:49.070692 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac96b72-fe8b-4abc-87f2-6dd768fad30e None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:49.071013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac96b72-fe8b-4abc-87f2-6dd768fad30e None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:49.071840 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac96b72-fe8b-4abc-87f2-6dd768fad30e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:49.072064 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac96b72-fe8b-4abc-87f2-6dd768fad30e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:49.073466 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac96b72-fe8b-4abc-87f2-6dd768fad30e None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:49.086867 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 428/873] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:06:49.093350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd10246-d206-4de3-a9af-1bf3fd6d8b97 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:49.215548 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd10246-d206-4de3-a9af-1bf3fd6d8b97 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:49.245081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:49.253471 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eedad7-1b43-411a-966e-9805de5989ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:49.254387 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eedad7-1b43-411a-966e-9805de5989ee None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:49.254704 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eedad7-1b43-411a-966e-9805de5989ee None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:49.255094 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eedad7-1b43-411a-966e-9805de5989ee None admin] PATH_INFO: `/v3/users/placement` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:49.265238 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eedad7-1b43-411a-966e-9805de5989ee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:49.266783 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eedad7-1b43-411a-966e-9805de5989ee None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:49.282972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-31eedad7-1b43-411a-966e-9805de5989ee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 11:06:49.282972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:49.282972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:49.282972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:49.282972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:49.282972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:49.282972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:49.282972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:49.282972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:49.282972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:49.282972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:49.282972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:49.282972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:06:49.282972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:06:49.282972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:06:49.282972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:06:49.284005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:49.284005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:49.284005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:06:49.284005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:06:49.284005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:06:49.284005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:06:49.284005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:49.284005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:49.284005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:49.284005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:49.284005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:49.284005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:49.284005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:49.284005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:49.284005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:49.284005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:49.284005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:49.284005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:49.285061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:49.285061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:49.285061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:06:49.285061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:06:49.285061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:06:49.285061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:06:49.285061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:06:49.285061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:06:49.285061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 11:06:49.285061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:06:49.285061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 446/874] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:06:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:06:49.291937 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac96b72-fe8b-4abc-87f2-6dd768fad30e None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:49.351965 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:49.418758 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac96b72-fe8b-4abc-87f2-6dd768fad30e None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:49.465695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21368cc-b40b-4902-b69a-17c27d1c7398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:49.466608 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21368cc-b40b-4902-b69a-17c27d1c7398 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:49.466918 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21368cc-b40b-4902-b69a-17c27d1c7398 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:49.467301 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21368cc-b40b-4902-b69a-17c27d1c7398 None admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:49.468589 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21368cc-b40b-4902-b69a-17c27d1c7398 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:49.469021 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21368cc-b40b-4902-b69a-17c27d1c7398 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:49.471676 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21368cc-b40b-4902-b69a-17c27d1c7398 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:49.501489 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 429/875] 10.222.0.71 () {56 vars in 1143 bytes} [Thu Jul 28 11:06:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:49.511450 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eedad7-1b43-411a-966e-9805de5989ee None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:49.640451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eedad7-1b43-411a-966e-9805de5989ee None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:49.677776 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e08d5-5a17-459f-8998-8d77761810b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:49.678492 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e08d5-5a17-459f-8998-8d77761810b2 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:49.678828 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e08d5-5a17-459f-8998-8d77761810b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:49.679158 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e08d5-5a17-459f-8998-8d77761810b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:49.745723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:49.764629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e08d5-5a17-459f-8998-8d77761810b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:49.766135 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e08d5-5a17-459f-8998-8d77761810b2 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:49.882404 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 447/876] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:06:49 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 11:06:49.889877 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21368cc-b40b-4902-b69a-17c27d1c7398 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:50.009911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21368cc-b40b-4902-b69a-17c27d1c7398 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:50.019976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:50.046407 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36567a9-60bc-4dd5-8eec-3e6293b5c0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:50.047052 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36567a9-60bc-4dd5-8eec-3e6293b5c0c6 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:50.047372 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36567a9-60bc-4dd5-8eec-3e6293b5c0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:50.047645 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36567a9-60bc-4dd5-8eec-3e6293b5c0c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:50.061306 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36567a9-60bc-4dd5-8eec-3e6293b5c0c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:50.063291 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36567a9-60bc-4dd5-8eec-3e6293b5c0c6 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:50.083147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-b36567a9-60bc-4dd5-8eec-3e6293b5c0c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:50.083147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:50.083147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:50.083147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:50.083147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:50.083147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:50.083147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:50.083147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:50.083147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:50.083147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:50.083147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:50.083147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:50.083147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:06:50.083147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:06:50.083147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:06:50.084371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:06:50.084371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:50.084371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:50.084371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:50.084371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:50.084371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:50.084371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:50.084371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:50.084371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:50.084371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:50.084371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:50.084371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:50.084371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:50.084371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:50.084371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:50.084371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:50.084371 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:50.085344 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:06:50.085344 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:06:50.085344 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:50.085344 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:06:50.085344 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 430/877] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:50.091999 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e08d5-5a17-459f-8998-8d77761810b2 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:50.195667 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:50.209300 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e08d5-5a17-459f-8998-8d77761810b2 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:50.246542 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93deda-d9e2-428d-9619-761d096e31d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:50.247357 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93deda-d9e2-428d-9619-761d096e31d5 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:50.247660 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93deda-d9e2-428d-9619-761d096e31d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:50.247945 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93deda-d9e2-428d-9619-761d096e31d5 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:50.248679 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93deda-d9e2-428d-9619-761d096e31d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:50.249014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93deda-d9e2-428d-9619-761d096e31d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:50.250454 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93deda-d9e2-428d-9619-761d096e31d5 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:50.270092 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 448/878] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:50.271245 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36567a9-60bc-4dd5-8eec-3e6293b5c0c6 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:50.385152 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36567a9-60bc-4dd5-8eec-3e6293b5c0c6 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:50.431918 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f3032-cbd3-4816-97cd-9a50b9552b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:50.432860 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f3032-cbd3-4816-97cd-9a50b9552b66 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:50.433229 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f3032-cbd3-4816-97cd-9a50b9552b66 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:50.433645 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f3032-cbd3-4816-97cd-9a50b9552b66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:50.444388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f3032-cbd3-4816-97cd-9a50b9552b66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:50.446511 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f3032-cbd3-4816-97cd-9a50b9552b66 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:50.464046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-1c7f3032-cbd3-4816-97cd-9a50b9552b66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:06:50.464046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:50.464046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:50.464046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:50.464046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:50.464046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:50.464046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:50.464046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:50.464046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:50.464046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:50.464046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:50.464046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:50.464046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:06:50.464046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:06:50.464046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:06:50.465343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:06:50.465343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:50.465343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:50.465343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:50.465343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:50.465343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:50.465343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:50.465343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:50.465343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:50.465343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:50.465343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:50.465343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:50.465343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:50.465343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:50.465343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:50.465343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:50.465343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:50.466488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:06:50.466488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:06:50.466488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:06:50.466488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:06:50.466488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:06:50.466488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:06:50.466488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:06:50.466488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:06:50.467627 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 431/879] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:06:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:50.473946 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93deda-d9e2-428d-9619-761d096e31d5 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:50.645983 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93deda-d9e2-428d-9619-761d096e31d5 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:50.689774 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdbc53-4c22-4ac8-ad36-5ecc61ee3dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:50.690405 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdbc53-4c22-4ac8-ad36-5ecc61ee3dfa None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:50.690687 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdbc53-4c22-4ac8-ad36-5ecc61ee3dfa None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:50.690965 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdbc53-4c22-4ac8-ad36-5ecc61ee3dfa None admin] PATH_INFO: `/v3/projects` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:50.691775 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdbc53-4c22-4ac8-ad36-5ecc61ee3dfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:50.692090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdbc53-4c22-4ac8-ad36-5ecc61ee3dfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:50.693526 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdbc53-4c22-4ac8-ad36-5ecc61ee3dfa None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:50.706158 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 449/880] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:06:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:50.713027 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f3032-cbd3-4816-97cd-9a50b9552b66 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:50.739811 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:50.822069 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f3032-cbd3-4816-97cd-9a50b9552b66 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:50.859078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe6550-ae9e-4e03-abf9-6c63412deed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:50.859801 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe6550-ae9e-4e03-abf9-6c63412deed1 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:50.860088 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe6550-ae9e-4e03-abf9-6c63412deed1 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:50.860376 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe6550-ae9e-4e03-abf9-6c63412deed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:50.861163 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe6550-ae9e-4e03-abf9-6c63412deed1 None admin] RBAC: Adding query filter params (role.id=f2a8452a65264f9ea10467160b1bd735, scope.project.id=11f4749185bf4adba9ae3cf927b6880b, user.id=8f4cb7d2680d4eb99a7328a54fcfd351) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:50.861475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe6550-ae9e-4e03-abf9-6c63412deed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:50.862929 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe6550-ae9e-4e03-abf9-6c63412deed1 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:50.869116 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 432/881] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:06:50 2022] GET /identity/v3/role_assignments?user.id=8f4cb7d2680d4eb99a7328a54fcfd351&scope.project.id=11f4749185bf4adba9ae3cf927b6880b&role.id=f2a8452a65264f9ea10467160b1bd735 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:53.085187 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ae739-0145-4c4e-b467-e5f537394f86 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:53.085747 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ae739-0145-4c4e-b467-e5f537394f86 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:53.085747 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ae739-0145-4c4e-b467-e5f537394f86 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:53.087084 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 450/882] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:06:53.092211 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e272b-2b71-4f4b-ad63-6411e1e36ef1 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:53.092644 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e272b-2b71-4f4b-ad63-6411e1e36ef1 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:53.092774 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e272b-2b71-4f4b-ad63-6411e1e36ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:53.111175 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-fe9e272b-2b71-4f4b-ad63-6411e1e36ef1 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:06:53.112396 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-fe9e272b-2b71-4f4b-ad63-6411e1e36ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:06:53.176972 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 433/883] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:06:53 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:06:53.199873 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ae739-0145-4c4e-b467-e5f537394f86 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:53.210929 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:53.300914 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ae739-0145-4c4e-b467-e5f537394f86 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:53.335452 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089a6e0-a521-4578-8067-a272d75dd426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:53.336023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089a6e0-a521-4578-8067-a272d75dd426 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:53.336306 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089a6e0-a521-4578-8067-a272d75dd426 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:53.336584 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089a6e0-a521-4578-8067-a272d75dd426 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:53.346342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089a6e0-a521-4578-8067-a272d75dd426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:06:53.351259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-f089a6e0-a521-4578-8067-a272d75dd426 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:06:53.351259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:53.351259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:53.351259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:53.351259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:53.351259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:53.351259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:53.351259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:53.351259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:53.351259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:53.351259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:53.351259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:53.351259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:06:53.351259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:06:53.351259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:06:53.351259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:06:53.352389 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:06:53.352389 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:06:53.352389 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:06:53.352389 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:06:53.352389 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:53.352389 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:53.352389 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:53.352389 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:53.352389 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:53.352389 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:53.352389 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:53.352389 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:53.352389 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:53.352389 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:53.352389 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:53.352389 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:53.353295 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:53.353295 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:53.353295 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:53.353295 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:53.353295 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:06:53.353295 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:06:53.353295 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:06:53.353295 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:06:53.353295 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:06:53.353295 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:06:53.353295 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:06:53.353295 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:06:53.353295 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 451/884] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Jul 28 11:06:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:53.358698 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e272b-2b71-4f4b-ad63-6411e1e36ef1 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:53.376156 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:53.464617 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e272b-2b71-4f4b-ad63-6411e1e36ef1 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:53.501435 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af7ee9-4209-4752-8651-65ed6c09becc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:53.502136 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af7ee9-4209-4752-8651-65ed6c09becc None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:53.502452 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af7ee9-4209-4752-8651-65ed6c09becc None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:53.502811 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af7ee9-4209-4752-8651-65ed6c09becc None admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:53.503742 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af7ee9-4209-4752-8651-65ed6c09becc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:53.504133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af7ee9-4209-4752-8651-65ed6c09becc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:53.506279 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af7ee9-4209-4752-8651-65ed6c09becc None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:53.516701 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 434/885] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:06:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:53.523028 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089a6e0-a521-4578-8067-a272d75dd426 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:53.595581 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:53.627972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089a6e0-a521-4578-8067-a272d75dd426 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:53.662214 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc976ea4-477d-4fac-b007-7d5243b8b067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:53.662853 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc976ea4-477d-4fac-b007-7d5243b8b067 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:53.663134 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc976ea4-477d-4fac-b007-7d5243b8b067 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:53.663446 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc976ea4-477d-4fac-b007-7d5243b8b067 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:53.673691 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc976ea4-477d-4fac-b007-7d5243b8b067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:53.675148 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc976ea4-477d-4fac-b007-7d5243b8b067 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:53.689752 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-dc976ea4-477d-4fac-b007-7d5243b8b067 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:53.689752 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:53.689752 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:53.689752 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:53.689752 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:53.689752 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:53.689752 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:53.689752 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:53.689752 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:53.689752 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:53.689752 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:53.689752 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:53.689752 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:06:53.689752 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:06:53.689752 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:06:53.690643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:06:53.690643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:53.690643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:53.690643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:53.690643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:53.690643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:53.690643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:53.690643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:53.690643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:53.690643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:53.690643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:53.690643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:53.690643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:53.690643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:53.690643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:53.690643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:53.690643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:53.691849 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:06:53.691849 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:06:53.691849 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:53.691849 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:06:53.691849 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 452/886] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:06:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:53.697400 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af7ee9-4209-4752-8651-65ed6c09becc None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:53.779184 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:53.801513 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af7ee9-4209-4752-8651-65ed6c09becc None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:53.834961 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a69a2-e501-4b52-ac40-c5a94c315341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:53.835621 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a69a2-e501-4b52-ac40-c5a94c315341 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:53.835910 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a69a2-e501-4b52-ac40-c5a94c315341 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:53.836191 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a69a2-e501-4b52-ac40-c5a94c315341 None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:53.836892 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a69a2-e501-4b52-ac40-c5a94c315341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:53.837202 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a69a2-e501-4b52-ac40-c5a94c315341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:53.840010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a69a2-e501-4b52-ac40-c5a94c315341 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:53.854362 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 435/887] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:53.860175 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc976ea4-477d-4fac-b007-7d5243b8b067 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:53.959134 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc976ea4-477d-4fac-b007-7d5243b8b067 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:53.978243 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:53.992444 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add595f-9c64-4d14-ba14-4251f54332a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:53.993089 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add595f-9c64-4d14-ba14-4251f54332a3 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:53.993369 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add595f-9c64-4d14-ba14-4251f54332a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:53.993670 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add595f-9c64-4d14-ba14-4251f54332a3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:54.001127 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add595f-9c64-4d14-ba14-4251f54332a3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:54.002563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add595f-9c64-4d14-ba14-4251f54332a3 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:54.014611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-9add595f-9c64-4d14-ba14-4251f54332a3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 11:06:54.014611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:54.014611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:54.014611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:54.014611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:54.014611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:54.014611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:54.014611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:54.014611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:54.014611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:54.014611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:54.014611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:54.014611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:06:54.014611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:06:54.014611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:06:54.014611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:06:54.015603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:54.015603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:54.015603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:06:54.015603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:06:54.015603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:06:54.015603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:06:54.015603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:54.015603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:54.015603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:54.015603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:54.015603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:54.015603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:54.015603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:54.015603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:54.015603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:54.015603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:54.015603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:54.015603 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:54.016596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:54.016596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:54.016596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:06:54.016596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:06:54.016596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:06:54.016596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:06:54.016596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:06:54.016596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:06:54.016596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 11:06:54.016596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:06:54.016596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 453/888] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:06:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:54.022049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a69a2-e501-4b52-ac40-c5a94c315341 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:54.119017 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a69a2-e501-4b52-ac40-c5a94c315341 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:54.152398 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d016c0-8092-494b-a7f0-e1c5c9125556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:54.153013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d016c0-8092-494b-a7f0-e1c5c9125556 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:54.153300 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d016c0-8092-494b-a7f0-e1c5c9125556 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:54.153580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d016c0-8092-494b-a7f0-e1c5c9125556 None admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:54.154364 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d016c0-8092-494b-a7f0-e1c5c9125556 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:54.154721 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d016c0-8092-494b-a7f0-e1c5c9125556 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:54.156148 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d016c0-8092-494b-a7f0-e1c5c9125556 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:54.158636 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:54.173575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 436/889] 10.222.0.71 () {56 vars in 1143 bytes} [Thu Jul 28 11:06:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:54.179330 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add595f-9c64-4d14-ba14-4251f54332a3 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:54.276066 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add595f-9c64-4d14-ba14-4251f54332a3 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:54.309194 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fad539-030c-4845-8188-7cf627589d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:54.309832 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fad539-030c-4845-8188-7cf627589d10 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:54.310113 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fad539-030c-4845-8188-7cf627589d10 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:54.310385 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fad539-030c-4845-8188-7cf627589d10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:54.321336 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fad539-030c-4845-8188-7cf627589d10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:54.322762 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fad539-030c-4845-8188-7cf627589d10 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:54.337745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-94fad539-030c-4845-8188-7cf627589d10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:54.337745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:54.337745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:54.337745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:54.337745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:54.337745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:54.337745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:54.337745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:54.337745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:54.337745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:54.337745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:54.337745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:54.337745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:06:54.337745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:06:54.337745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:06:54.338771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:06:54.338771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:54.338771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:54.338771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:54.338771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:54.338771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:54.338771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:54.338771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:54.338771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:54.338771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:54.338771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:54.338771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:54.338771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:54.338771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:54.338771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:54.338771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:54.338771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:54.339731 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:06:54.339731 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:06:54.339731 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:54.339731 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:06:54.339731 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 454/890] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:54.344626 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d016c0-8092-494b-a7f0-e1c5c9125556 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:54.443151 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d016c0-8092-494b-a7f0-e1c5c9125556 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:54.480256 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e9870-cb5c-4c10-849e-10fcaa7e1459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:54.480870 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e9870-cb5c-4c10-849e-10fcaa7e1459 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:54.481157 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e9870-cb5c-4c10-849e-10fcaa7e1459 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:54.481437 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e9870-cb5c-4c10-849e-10fcaa7e1459 None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:54.482160 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e9870-cb5c-4c10-849e-10fcaa7e1459 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:54.482660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e9870-cb5c-4c10-849e-10fcaa7e1459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:54.483861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e9870-cb5c-4c10-849e-10fcaa7e1459 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:54.496541 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 437/891] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:54.502252 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fad539-030c-4845-8188-7cf627589d10 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:54.533984 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:54.601881 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fad539-030c-4845-8188-7cf627589d10 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:54.634259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a91aa3-96c8-426d-94dd-2af0cfb08ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:54.634833 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a91aa3-96c8-426d-94dd-2af0cfb08ee5 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:54.635121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a91aa3-96c8-426d-94dd-2af0cfb08ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:54.635441 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a91aa3-96c8-426d-94dd-2af0cfb08ee5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:54.642240 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a91aa3-96c8-426d-94dd-2af0cfb08ee5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:54.643760 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a91aa3-96c8-426d-94dd-2af0cfb08ee5 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:54.655977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-02a91aa3-96c8-426d-94dd-2af0cfb08ee5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:06:54.655977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:54.655977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:54.655977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:54.655977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:54.655977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:54.655977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:54.655977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:54.655977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:54.655977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:54.655977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:54.655977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:54.655977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:06:54.655977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:06:54.655977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:06:54.657001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:06:54.657001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:54.657001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:54.657001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:54.657001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:54.657001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:54.657001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:54.657001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:54.657001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:54.657001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:54.657001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:54.657001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:54.657001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:54.657001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:54.657001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:54.657001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:54.657001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:54.657891 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:06:54.657891 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:06:54.657891 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:06:54.657891 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:06:54.657891 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:06:54.657891 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:06:54.657891 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:06:54.657891 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:06:54.657891 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 455/892] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:06:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:54.663747 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e9870-cb5c-4c10-849e-10fcaa7e1459 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:54.717480 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:54.761069 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e9870-cb5c-4c10-849e-10fcaa7e1459 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:54.794157 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1c0fb-45ec-4b75-b1c3-fe4bd4bc2c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:54.794767 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1c0fb-45ec-4b75-b1c3-fe4bd4bc2c61 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:54.795047 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1c0fb-45ec-4b75-b1c3-fe4bd4bc2c61 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:54.795350 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1c0fb-45ec-4b75-b1c3-fe4bd4bc2c61 None admin] PATH_INFO: `/v3/projects` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:54.796085 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1c0fb-45ec-4b75-b1c3-fe4bd4bc2c61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:54.796389 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1c0fb-45ec-4b75-b1c3-fe4bd4bc2c61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:54.797834 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1c0fb-45ec-4b75-b1c3-fe4bd4bc2c61 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:54.810119 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 438/893] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:06:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:54.816294 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a91aa3-96c8-426d-94dd-2af0cfb08ee5 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:54.909627 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:54.918568 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a91aa3-96c8-426d-94dd-2af0cfb08ee5 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:54.951099 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a78047-6230-410e-82e2-0c3ed63793be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:54.951793 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a78047-6230-410e-82e2-0c3ed63793be None admin] REQUEST_METHOD: `PUT` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:54.952077 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a78047-6230-410e-82e2-0c3ed63793be None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:54.952356 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a78047-6230-410e-82e2-0c3ed63793be None admin] PATH_INFO: `/v3/projects/11f4749185bf4adba9ae3cf927b6880b/users/8f4cb7d2680d4eb99a7328a54fcfd351/roles/f2a8452a65264f9ea10467160b1bd735` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:54.954251 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a78047-6230-410e-82e2-0c3ed63793be None admin] RBAC: Authorizing `identity:create_grant(project_id=11f4749185bf4adba9ae3cf927b6880b, user_id=8f4cb7d2680d4eb99a7328a54fcfd351, role_id=f2a8452a65264f9ea10467160b1bd735)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:54.955709 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a78047-6230-410e-82e2-0c3ed63793be None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:54.968325 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 456/894] 10.222.0.71 () {58 vars in 1439 bytes} [Thu Jul 28 11:06:54 2022] PUT /identity/v3/projects/11f4749185bf4adba9ae3cf927b6880b/users/8f4cb7d2680d4eb99a7328a54fcfd351/roles/f2a8452a65264f9ea10467160b1bd735 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 11:06:57.160814 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cdd5c-af3b-4518-ab3d-719ac0b342a1 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:57.161351 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cdd5c-af3b-4518-ab3d-719ac0b342a1 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:57.161351 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cdd5c-af3b-4518-ab3d-719ac0b342a1 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:57.163218 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 439/895] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:06:57.168476 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc7424-ec8c-4168-905d-7fe01008ba64 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:57.168884 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc7424-ec8c-4168-905d-7fe01008ba64 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:57.169028 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc7424-ec8c-4168-905d-7fe01008ba64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:57.187187 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-d2cc7424-ec8c-4168-905d-7fe01008ba64 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:06:57.188397 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-d2cc7424-ec8c-4168-905d-7fe01008ba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:06:57.252182 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 457/896] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:06:57 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:06:57.276752 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cdd5c-af3b-4518-ab3d-719ac0b342a1 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:57.375548 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cdd5c-af3b-4518-ab3d-719ac0b342a1 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:57.390123 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:57.410976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3547d77-93f1-435f-9bc0-f0e4eb3fc575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:57.411576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3547d77-93f1-435f-9bc0-f0e4eb3fc575 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:57.411865 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3547d77-93f1-435f-9bc0-f0e4eb3fc575 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:57.412145 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3547d77-93f1-435f-9bc0-f0e4eb3fc575 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:57.422522 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3547d77-93f1-435f-9bc0-f0e4eb3fc575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 11:06:57.427486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-d3547d77-93f1-435f-9bc0-f0e4eb3fc575 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:06:57.427486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:57.427486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:57.427486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:57.427486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:57.427486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:57.427486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:57.427486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:57.427486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:57.427486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:57.427486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:57.427486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:57.427486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 11:06:57.427486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 11:06:57.427486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 11:06:57.427486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 11:06:57.429078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 11:06:57.429078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 11:06:57.429078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 11:06:57.429078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 11:06:57.429078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:57.429078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:57.429078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:57.429078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:57.429078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:57.429078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:57.429078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:57.429078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:57.429078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:57.429078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:57.429078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:57.429078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:57.430254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:57.430254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:57.430254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:57.430254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:57.430254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 11:06:57.430254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 11:06:57.430254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 11:06:57.430254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 11:06:57.430254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 11:06:57.430254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 11:06:57.430254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 11:06:57.430254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:06:57.430254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 440/897] 10.222.0.71 () {56 vars in 1096 bytes} [Thu Jul 28 11:06:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:57.435188 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc7424-ec8c-4168-905d-7fe01008ba64 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:57.519489 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:57.540471 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc7424-ec8c-4168-905d-7fe01008ba64 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:57.574961 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a72025-9f53-4b56-b18c-f8d7cc18ff17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:57.575616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a72025-9f53-4b56-b18c-f8d7cc18ff17 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:57.575901 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a72025-9f53-4b56-b18c-f8d7cc18ff17 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:57.576178 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a72025-9f53-4b56-b18c-f8d7cc18ff17 None admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:57.576889 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a72025-9f53-4b56-b18c-f8d7cc18ff17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:57.577196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a72025-9f53-4b56-b18c-f8d7cc18ff17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:57.578571 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a72025-9f53-4b56-b18c-f8d7cc18ff17 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:57.586930 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 458/898] 10.222.0.71 () {56 vars in 1099 bytes} [Thu Jul 28 11:06:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:57.592660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3547d77-93f1-435f-9bc0-f0e4eb3fc575 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:57.696307 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3547d77-93f1-435f-9bc0-f0e4eb3fc575 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:57.729802 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6b51e-92a3-4fa3-a5b0-1b00ab8ee752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:57.730446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6b51e-92a3-4fa3-a5b0-1b00ab8ee752 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:57.730731 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6b51e-92a3-4fa3-a5b0-1b00ab8ee752 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:57.731009 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6b51e-92a3-4fa3-a5b0-1b00ab8ee752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:57.741546 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6b51e-92a3-4fa3-a5b0-1b00ab8ee752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:57.744045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6b51e-92a3-4fa3-a5b0-1b00ab8ee752 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:57.761542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-a6a6b51e-92a3-4fa3-a5b0-1b00ab8ee752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:57.761542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:57.761542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:57.761542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:57.761542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:57.761542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:57.761542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:57.761542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:57.761542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:57.761542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:57.761542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:57.761542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:57.761542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:06:57.761542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:06:57.761542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:06:57.762619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:06:57.762619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:57.762619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:57.762619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:57.762619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:57.762619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:57.762619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:57.762619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:57.762619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:57.762619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:57.762619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:57.762619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:57.762619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:57.762619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:57.762619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:57.762619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:57.762619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:57.763577 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:06:57.763577 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:06:57.763577 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:57.763577 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:06:57.763577 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 441/899] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:06:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:57.768716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a72025-9f53-4b56-b18c-f8d7cc18ff17 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:57.867178 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a72025-9f53-4b56-b18c-f8d7cc18ff17 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:57.901095 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c203df-822f-4ca6-a4df-49181a602f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:57.901714 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c203df-822f-4ca6-a4df-49181a602f93 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:57.902004 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c203df-822f-4ca6-a4df-49181a602f93 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:57.902280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c203df-822f-4ca6-a4df-49181a602f93 None admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:57.903498 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c203df-822f-4ca6-a4df-49181a602f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:57.903498 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c203df-822f-4ca6-a4df-49181a602f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:57.904705 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c203df-822f-4ca6-a4df-49181a602f93 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:57.917012 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 459/900] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:57.922631 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6b51e-92a3-4fa3-a5b0-1b00ab8ee752 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:57.950150 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:58.020243 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6b51e-92a3-4fa3-a5b0-1b00ab8ee752 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:58.052692 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507e3eb-1809-4915-b47f-5927427bacd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:58.053829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507e3eb-1809-4915-b47f-5927427bacd0 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:58.054113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507e3eb-1809-4915-b47f-5927427bacd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:58.054389 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507e3eb-1809-4915-b47f-5927427bacd0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:58.061758 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507e3eb-1809-4915-b47f-5927427bacd0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:58.063192 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507e3eb-1809-4915-b47f-5927427bacd0 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:58.074118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-b507e3eb-1809-4915-b47f-5927427bacd0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 11:06:58.074118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:58.074118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:58.074118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:58.074118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:58.074118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:58.074118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:58.074118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:58.074118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:58.074118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:58.074118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:58.074118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:58.074118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 11:06:58.074118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 11:06:58.074118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 11:06:58.074118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 11:06:58.075048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:58.075048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:58.075048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 11:06:58.075048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:06:58.075048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 11:06:58.075048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 11:06:58.075048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:58.075048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:58.075048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:58.075048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:58.075048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:58.075048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:58.075048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:58.075048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:58.075048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:58.075048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:58.075048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:58.075048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:58.076122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:58.076122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:58.076122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 11:06:58.076122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 11:06:58.076122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 11:06:58.076122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 11:06:58.076122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 11:06:58.076122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 11:06:58.076122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 11:06:58.076122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:06:58.076122 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 442/901] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:06:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:58.081281 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c203df-822f-4ca6-a4df-49181a602f93 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:58.085075 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:58.179290 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c203df-822f-4ca6-a4df-49181a602f93 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:58.212474 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7639e95-73b2-42ae-807e-22ef9efecd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:58.213023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7639e95-73b2-42ae-807e-22ef9efecd97 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:58.213308 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7639e95-73b2-42ae-807e-22ef9efecd97 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:58.213588 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7639e95-73b2-42ae-807e-22ef9efecd97 None admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:58.214372 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7639e95-73b2-42ae-807e-22ef9efecd97 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:58.214684 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7639e95-73b2-42ae-807e-22ef9efecd97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:58.216152 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7639e95-73b2-42ae-807e-22ef9efecd97 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:58.234027 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 460/902] 10.222.0.71 () {56 vars in 1143 bytes} [Thu Jul 28 11:06:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:58.239838 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507e3eb-1809-4915-b47f-5927427bacd0 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:58.323348 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:58.338411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507e3eb-1809-4915-b47f-5927427bacd0 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:58.371067 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43355b3f-2031-4c17-b146-dec07f46ce7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:58.371720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43355b3f-2031-4c17-b146-dec07f46ce7b None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:58.372010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43355b3f-2031-4c17-b146-dec07f46ce7b None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:58.372298 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43355b3f-2031-4c17-b146-dec07f46ce7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:58.442441 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43355b3f-2031-4c17-b146-dec07f46ce7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:58.444496 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43355b3f-2031-4c17-b146-dec07f46ce7b None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:58.527889 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:58.543595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 443/903] 10.222.0.71 () {58 vars in 1282 bytes} [Thu Jul 28 11:06:58 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 11:06:58.549319 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7639e95-73b2-42ae-807e-22ef9efecd97 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:58.609293 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:58.647989 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7639e95-73b2-42ae-807e-22ef9efecd97 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:58.680521 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe9cbf-4e4c-450f-8e1d-9ae39eb0ffd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:58.681157 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe9cbf-4e4c-450f-8e1d-9ae39eb0ffd1 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:58.681438 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe9cbf-4e4c-450f-8e1d-9ae39eb0ffd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:58.681715 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe9cbf-4e4c-450f-8e1d-9ae39eb0ffd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:58.691468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe9cbf-4e4c-450f-8e1d-9ae39eb0ffd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:58.692898 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe9cbf-4e4c-450f-8e1d-9ae39eb0ffd1 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:58.707682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-bcbe9cbf-4e4c-450f-8e1d-9ae39eb0ffd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:58.707682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:58.707682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:58.707682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:58.707682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:58.707682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:58.707682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:58.707682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:58.707682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:58.707682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:58.707682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:58.707682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:58.707682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 11:06:58.707682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 11:06:58.707682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 11:06:58.708711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 11:06:58.708711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:58.708711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:58.708711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:58.708711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:58.708711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:58.708711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:58.708711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:58.708711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:58.708711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:58.708711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:58.708711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:58.708711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:58.708711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:58.708711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:58.708711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:58.708711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:58.710196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 11:06:58.710196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 11:06:58.710196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 11:06:58.710196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:06:58.710196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 461/904] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:06:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:06:58.715728 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43355b3f-2031-4c17-b146-dec07f46ce7b None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:58.813135 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43355b3f-2031-4c17-b146-dec07f46ce7b None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:58.846455 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85968925-e1c9-4a9d-b765-06a1691ada62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:58.847073 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85968925-e1c9-4a9d-b765-06a1691ada62 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:58.847385 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85968925-e1c9-4a9d-b765-06a1691ada62 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:58.847666 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85968925-e1c9-4a9d-b765-06a1691ada62 None admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:58.848356 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85968925-e1c9-4a9d-b765-06a1691ada62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:58.848661 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85968925-e1c9-4a9d-b765-06a1691ada62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:58.850064 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85968925-e1c9-4a9d-b765-06a1691ada62 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:58.862643 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 444/905] 10.222.0.71 () {56 vars in 1109 bytes} [Thu Jul 28 11:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:58.868966 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe9cbf-4e4c-450f-8e1d-9ae39eb0ffd1 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:58.967927 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe9cbf-4e4c-450f-8e1d-9ae39eb0ffd1 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:58.981553 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:59.001314 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76dd79-d817-41d2-a44a-b037599371f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:59.001963 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76dd79-d817-41d2-a44a-b037599371f6 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:59.002253 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76dd79-d817-41d2-a44a-b037599371f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:59.002554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76dd79-d817-41d2-a44a-b037599371f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:59.009483 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76dd79-d817-41d2-a44a-b037599371f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:59.010925 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76dd79-d817-41d2-a44a-b037599371f6 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:59.023003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application [None req-9f76dd79-d817-41d2-a44a-b037599371f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:06:59.023003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:06:59.023003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:06:59.023003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:06:59.023003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:06:59.023003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:06:59.023003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:06:59.023003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:06:59.023003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:06:59.023003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:06:59.023003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:06:59.023003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:06:59.023003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 11:06:59.023003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 11:06:59.023003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 11:06:59.024090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 11:06:59.024090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:06:59.024090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:06:59.024090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:06:59.024090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:06:59.024090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:06:59.024090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:06:59.024090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:06:59.024090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application with Lock( Jul 28 11:06:59.024090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:06:59.024090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:06:59.024090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:06:59.024090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:06:59.024090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:06:59.024090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:06:59.024090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:06:59.024090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:06:59.029967 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 11:06:59.029967 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 11:06:59.029967 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 11:06:59.029967 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 11:06:59.029967 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 11:06:59.029967 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 11:06:59.029967 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 11:06:59.029967 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: ERROR keystone.server.flask.application Jul 28 11:06:59.029967 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 462/906] 10.222.0.71 () {56 vars in 1111 bytes} [Thu Jul 28 11:06:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 11:06:59.030560 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85968925-e1c9-4a9d-b765-06a1691ada62 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:59.076508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:06:59.129321 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85968925-e1c9-4a9d-b765-06a1691ada62 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:59.163390 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5e315-2676-4229-baf1-16040560a84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:59.164008 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5e315-2676-4229-baf1-16040560a84b None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:59.164288 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5e315-2676-4229-baf1-16040560a84b None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:59.164562 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5e315-2676-4229-baf1-16040560a84b None admin] PATH_INFO: `/v3/projects` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:59.165295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5e315-2676-4229-baf1-16040560a84b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:59.165599 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5e315-2676-4229-baf1-16040560a84b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:59.167021 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5e315-2676-4229-baf1-16040560a84b None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:59.178504 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 445/907] 10.222.0.71 () {56 vars in 1148 bytes} [Thu Jul 28 11:06:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:06:59.184535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76dd79-d817-41d2-a44a-b037599371f6 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:06:59.282580 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76dd79-d817-41d2-a44a-b037599371f6 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:06:59.315588 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220e427-72fa-45aa-aa7c-f218c0ee32a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:06:59.316623 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220e427-72fa-45aa-aa7c-f218c0ee32a4 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:06:59.316623 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220e427-72fa-45aa-aa7c-f218c0ee32a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:06:59.316836 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220e427-72fa-45aa-aa7c-f218c0ee32a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:06:59.317624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220e427-72fa-45aa-aa7c-f218c0ee32a4 None admin] RBAC: Adding query filter params (role.id=f2a8452a65264f9ea10467160b1bd735, scope.project.id=11f4749185bf4adba9ae3cf927b6880b, user.id=8f4cb7d2680d4eb99a7328a54fcfd351) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:06:59.317845 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220e427-72fa-45aa-aa7c-f218c0ee32a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:06:59.319854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220e427-72fa-45aa-aa7c-f218c0ee32a4 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:06:59.325554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 463/908] 10.222.0.71 () {56 vars in 1374 bytes} [Thu Jul 28 11:06:59 2022] GET /identity/v3/role_assignments?user.id=8f4cb7d2680d4eb99a7328a54fcfd351&scope.project.id=11f4749185bf4adba9ae3cf927b6880b&role.id=f2a8452a65264f9ea10467160b1bd735 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:07:01.540804 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f370c9-3ac9-460f-a5ad-e651f608bdb3 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:07:01.541414 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f370c9-3ac9-460f-a5ad-e651f608bdb3 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:07:01.541533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f370c9-3ac9-460f-a5ad-e651f608bdb3 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:07:01.543028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 446/909] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:07:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:07:01.548348 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedf70f-6c78-462b-b0f5-b62d147b1f1c None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:07:01.548748 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedf70f-6c78-462b-b0f5-b62d147b1f1c None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:07:01.548911 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedf70f-6c78-462b-b0f5-b62d147b1f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:07:01.566639 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-adedf70f-6c78-462b-b0f5-b62d147b1f1c None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:07:01.567846 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-adedf70f-6c78-462b-b0f5-b62d147b1f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:07:01.598289 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:07:01.636081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 464/910] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:07:01 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:07:01.662335 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f370c9-3ac9-460f-a5ad-e651f608bdb3 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:07:01.760657 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f370c9-3ac9-460f-a5ad-e651f608bdb3 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:07:01.767918 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:07:01.794149 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91b801-e463-4301-91fb-a7ff903b50bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:07:01.794778 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91b801-e463-4301-91fb-a7ff903b50bb None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:07:01.795059 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91b801-e463-4301-91fb-a7ff903b50bb None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:07:01.795359 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91b801-e463-4301-91fb-a7ff903b50bb None admin] PATH_INFO: `/v3/services/placement` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:07:01.795993 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91b801-e463-4301-91fb-a7ff903b50bb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:07:01.797355 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91b801-e463-4301-91fb-a7ff903b50bb None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:07:01.806028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-9f91b801-e463-4301-91fb-a7ff903b50bb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 11:07:01.806028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:07:01.806028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:07:01.806028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:07:01.806028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:07:01.806028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:07:01.806028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:07:01.806028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:07:01.806028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 11:07:01.806028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:07:01.806028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:07:01.806028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:07:01.806028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:07:01.806028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:07:01.806028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:07:01.806028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:07:01.806028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:07:01.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:07:01.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:07:01.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:07:01.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:07:01.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:07:01.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:07:01.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:07:01.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:07:01.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:07:01.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:07:01.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:07:01.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:07:01.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:07:01.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:07:01.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:07:01.809387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:07:01.811039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:07:01.811039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:07:01.811039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:07:01.811039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:07:01.811039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:07:01.811039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:07:01.811039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:07:01.811039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:07:01.811039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:07:01.811039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:07:01.811039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:07:01.811039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:07:01.811039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 11:07:01.811039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:07:01.811039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 447/911] 10.222.0.71 () {56 vars in 1117 bytes} [Thu Jul 28 11:07:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:07:01.817127 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adedf70f-6c78-462b-b0f5-b62d147b1f1c None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:07:01.914326 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adedf70f-6c78-462b-b0f5-b62d147b1f1c None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:07:01.950562 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9e22f-560f-4f18-9039-ca9b635e8a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:07:01.951184 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9e22f-560f-4f18-9039-ca9b635e8a14 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:07:01.951495 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9e22f-560f-4f18-9039-ca9b635e8a14 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:07:01.951769 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9e22f-560f-4f18-9039-ca9b635e8a14 None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:07:01.952448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9e22f-560f-4f18-9039-ca9b635e8a14 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:07:01.952760 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9e22f-560f-4f18-9039-ca9b635e8a14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:07:01.954130 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9e22f-560f-4f18-9039-ca9b635e8a14 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:07:01.959667 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 465/912] 10.222.0.71 () {56 vars in 1116 bytes} [Thu Jul 28 11:07:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:07:01.969608 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91b801-e463-4301-91fb-a7ff903b50bb None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:07:02.068231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91b801-e463-4301-91fb-a7ff903b50bb None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:07:02.100796 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc43cd-04ca-4a02-92c6-c0fc203b38fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:07:02.101406 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc43cd-04ca-4a02-92c6-c0fc203b38fa None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:07:02.101690 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc43cd-04ca-4a02-92c6-c0fc203b38fa None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:07:02.101967 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc43cd-04ca-4a02-92c6-c0fc203b38fa None admin] PATH_INFO: `/v3/services` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:07:02.102635 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc43cd-04ca-4a02-92c6-c0fc203b38fa None admin] RBAC: Adding query filter params (type=placement) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:07:02.102940 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc43cd-04ca-4a02-92c6-c0fc203b38fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:07:02.104354 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc43cd-04ca-4a02-92c6-c0fc203b38fa None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:07:02.108635 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 448/913] 10.222.0.71 () {56 vars in 1116 bytes} [Thu Jul 28 11:07:01 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:07:04.348824 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64a596-5821-4459-a688-9f6c346eeab1 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:07:04.349446 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64a596-5821-4459-a688-9f6c346eeab1 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:07:04.349600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64a596-5821-4459-a688-9f6c346eeab1 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:07:04.352339 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 466/914] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:07:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:07:04.358580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e58a09-81c3-4393-87d3-85b0ea66956b None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:07:04.359031 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e58a09-81c3-4393-87d3-85b0ea66956b None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:07:04.359147 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e58a09-81c3-4393-87d3-85b0ea66956b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:07:04.380045 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-98e58a09-81c3-4393-87d3-85b0ea66956b None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:07:04.380409 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-98e58a09-81c3-4393-87d3-85b0ea66956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:07:04.409465 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:07:04.451989 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 449/915] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:07:04 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:07:04.480656 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64a596-5821-4459-a688-9f6c346eeab1 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:07:04.518683 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:07:04.601256 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64a596-5821-4459-a688-9f6c346eeab1 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:07:04.639681 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240ff5d-d093-44fe-87bc-5f4e19d2d55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:07:04.640300 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240ff5d-d093-44fe-87bc-5f4e19d2d55c None admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:07:04.640589 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240ff5d-d093-44fe-87bc-5f4e19d2d55c None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:07:04.640972 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240ff5d-d093-44fe-87bc-5f4e19d2d55c None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:07:04.641993 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240ff5d-d093-44fe-87bc-5f4e19d2d55c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:07:04.643393 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240ff5d-d093-44fe-87bc-5f4e19d2d55c None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:07:04.658668 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 467/916] 10.222.0.71 () {60 vars in 1141 bytes} [Thu Jul 28 11:07:04 2022] POST /identity/v3/services => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 11:07:06.919461 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faff3c-7b1c-493c-aeea-22d73e85c537 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:07:06.919988 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faff3c-7b1c-493c-aeea-22d73e85c537 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:07:06.920096 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faff3c-7b1c-493c-aeea-22d73e85c537 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:07:06.921358 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 450/917] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:07:06.926486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2145364-f752-473d-813b-d0646b3ebd38 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:07:06.926867 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2145364-f752-473d-813b-d0646b3ebd38 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:07:06.927050 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2145364-f752-473d-813b-d0646b3ebd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:07:06.948597 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-d2145364-f752-473d-813b-d0646b3ebd38 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:07:06.950119 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-d2145364-f752-473d-813b-d0646b3ebd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:07:07.021665 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 468/918] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:07:06 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:07:07.045769 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86faff3c-7b1c-493c-aeea-22d73e85c537 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:07:07.144705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86faff3c-7b1c-493c-aeea-22d73e85c537 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:07:07.177418 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f53b2b-5dad-428d-9dcd-5c07a8ff8086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:07:07.178518 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f53b2b-5dad-428d-9dcd-5c07a8ff8086 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:07:07.178807 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f53b2b-5dad-428d-9dcd-5c07a8ff8086 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:07:07.179089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f53b2b-5dad-428d-9dcd-5c07a8ff8086 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:07:07.179750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f53b2b-5dad-428d-9dcd-5c07a8ff8086 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:07:07.181129 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f53b2b-5dad-428d-9dcd-5c07a8ff8086 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:07:07.190112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-c4f53b2b-5dad-428d-9dcd-5c07a8ff8086 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 11:07:07.190112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:07:07.190112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:07:07.190112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:07:07.190112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:07:07.190112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:07:07.190112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:07:07.190112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:07:07.190112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 11:07:07.190112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:07:07.190112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:07:07.190112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:07:07.190112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:07:07.190112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:07:07.190112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:07:07.190112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:07:07.190112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:07:07.191294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:07:07.191294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:07:07.191294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:07:07.191294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:07:07.191294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:07:07.191294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:07:07.191294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:07:07.191294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:07:07.191294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:07:07.191294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:07:07.191294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:07:07.191294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:07:07.191294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:07:07.191294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:07:07.191294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:07:07.191294 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:07:07.192196 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:07:07.192196 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:07:07.192196 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:07:07.192196 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:07:07.192196 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:07:07.192196 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:07:07.192196 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:07:07.192196 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:07:07.192196 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:07:07.192196 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:07:07.192196 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:07:07.192196 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:07:07.192196 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 11:07:07.192196 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:07:07.192196 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 451/919] 10.222.0.71 () {56 vars in 1117 bytes} [Thu Jul 28 11:07:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:07:07.197279 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2145364-f752-473d-813b-d0646b3ebd38 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:07:07.215484 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:07:07.296482 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2145364-f752-473d-813b-d0646b3ebd38 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:07:07.329734 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0650d6b-9945-46c7-8019-de4f3bee0f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:07:07.330352 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0650d6b-9945-46c7-8019-de4f3bee0f45 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:07:07.330643 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0650d6b-9945-46c7-8019-de4f3bee0f45 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:07:07.330926 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0650d6b-9945-46c7-8019-de4f3bee0f45 None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:07:07.331635 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0650d6b-9945-46c7-8019-de4f3bee0f45 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:07:07.331950 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0650d6b-9945-46c7-8019-de4f3bee0f45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:07:07.333317 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0650d6b-9945-46c7-8019-de4f3bee0f45 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:07:07.338783 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 469/920] 10.222.0.71 () {56 vars in 1116 bytes} [Thu Jul 28 11:07:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:07:07.344664 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f53b2b-5dad-428d-9dcd-5c07a8ff8086 None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:07:07.373186 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:07:07.444074 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f53b2b-5dad-428d-9dcd-5c07a8ff8086 None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:07:07.476714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26faaa7-4ac4-4947-94c1-105abf4e2eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:07:07.477329 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26faaa7-4ac4-4947-94c1-105abf4e2eb1 None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:07:07.477610 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26faaa7-4ac4-4947-94c1-105abf4e2eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:07:07.477883 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26faaa7-4ac4-4947-94c1-105abf4e2eb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:07:07.478631 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26faaa7-4ac4-4947-94c1-105abf4e2eb1 None admin] RBAC: Adding query filter params (interface=public, service_id=a4e122df075345bd899cec8d40e534d3, region_id=RegionOne) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:07:07.478944 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26faaa7-4ac4-4947-94c1-105abf4e2eb1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:07:07.480351 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26faaa7-4ac4-4947-94c1-105abf4e2eb1 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:07:07.485251 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 452/921] 10.222.0.71 () {56 vars in 1251 bytes} [Thu Jul 28 11:07:07 2022] GET /identity/v3/endpoints?service_id=a4e122df075345bd899cec8d40e534d3&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:07:07.490994 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0650d6b-9945-46c7-8019-de4f3bee0f45 None admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:07:07.569847 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:07:07.588306 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0650d6b-9945-46c7-8019-de4f3bee0f45 None admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:07:07.620998 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228d885-3be5-4880-8653-f6e8f3a80332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:07:07.621629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228d885-3be5-4880-8653-f6e8f3a80332 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:07:07.621917 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228d885-3be5-4880-8653-f6e8f3a80332 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:07:07.622197 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228d885-3be5-4880-8653-f6e8f3a80332 None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:07:07.622853 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228d885-3be5-4880-8653-f6e8f3a80332 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:07:07.624303 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228d885-3be5-4880-8653-f6e8f3a80332 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:07:07.632038 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 470/922] 10.222.0.71 () {56 vars in 1087 bytes} [Thu Jul 28 11:07:07 2022] GET /identity/v3/services => generated 1962 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 11:07:09.858641 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379a46e-7df4-49b9-a538-0251d9385ea9 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:07:09.859221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379a46e-7df4-49b9-a538-0251d9385ea9 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:07:09.859221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379a46e-7df4-49b9-a538-0251d9385ea9 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:07:09.860563 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 453/923] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:07:09.866211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa6c6a-e61a-491e-84c6-976e43021c21 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:07:09.866658 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa6c6a-e61a-491e-84c6-976e43021c21 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:07:09.866758 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa6c6a-e61a-491e-84c6-976e43021c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:07:09.885883 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-faaa6c6a-e61a-491e-84c6-976e43021c21 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:07:09.887103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-faaa6c6a-e61a-491e-84c6-976e43021c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:07:09.959637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 471/924] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:07:09 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 11:07:09.984039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379a46e-7df4-49b9-a538-0251d9385ea9 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:07:10.074679 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:07:10.084661 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379a46e-7df4-49b9-a538-0251d9385ea9 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:07:10.118083 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22193d9e-bf88-4ea7-90bc-ab8918f9b9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:07:10.119184 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22193d9e-bf88-4ea7-90bc-ab8918f9b9bc None admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:07:10.119492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22193d9e-bf88-4ea7-90bc-ab8918f9b9bc None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:07:10.119767 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22193d9e-bf88-4ea7-90bc-ab8918f9b9bc None admin] PATH_INFO: `/v3/services/placement` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:07:10.120384 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22193d9e-bf88-4ea7-90bc-ab8918f9b9bc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:07:10.121763 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22193d9e-bf88-4ea7-90bc-ab8918f9b9bc None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:07:10.130502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application [None req-22193d9e-bf88-4ea7-90bc-ab8918f9b9bc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 11:07:10.130502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:07:10.130502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 11:07:10.130502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 11:07:10.130502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 11:07:10.130502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 11:07:10.130502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 11:07:10.130502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:07:10.130502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 11:07:10.130502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:07:10.130502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 11:07:10.130502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:07:10.130502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 11:07:10.130502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 11:07:10.130502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 11:07:10.130502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 11:07:10.130502 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 11:07:10.131759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 11:07:10.131759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 11:07:10.131759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 11:07:10.131759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 11:07:10.131759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 11:07:10.131759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 11:07:10.131759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 11:07:10.131759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 11:07:10.131759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 11:07:10.131759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 11:07:10.131759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 11:07:10.131759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 11:07:10.131759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 11:07:10.131759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 11:07:10.131759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 11:07:10.131759 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 11:07:10.132653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 11:07:10.132653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application with Lock( Jul 28 11:07:10.132653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 11:07:10.132653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self._enter() Jul 28 11:07:10.132653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 11:07:10.132653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 11:07:10.132653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 11:07:10.132653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application return self.creator() Jul 28 11:07:10.132653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 11:07:10.132653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application created_value = creator( Jul 28 11:07:10.132653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 11:07:10.132653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 11:07:10.132653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 11:07:10.132653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: ERROR keystone.server.flask.application Jul 28 11:07:10.132653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 454/925] 10.222.0.71 () {56 vars in 1117 bytes} [Thu Jul 28 11:07:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 11:07:10.137728 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa6c6a-e61a-491e-84c6-976e43021c21 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:07:10.211996 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:07:10.235187 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa6c6a-e61a-491e-84c6-976e43021c21 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:07:10.268398 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce730ee-1bb6-41bd-a1a8-578e3bded9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:07:10.269017 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce730ee-1bb6-41bd-a1a8-578e3bded9a7 None admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:07:10.269297 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce730ee-1bb6-41bd-a1a8-578e3bded9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:07:10.269572 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce730ee-1bb6-41bd-a1a8-578e3bded9a7 None admin] PATH_INFO: `/v3/services` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:07:10.270242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce730ee-1bb6-41bd-a1a8-578e3bded9a7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:07:10.270546 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce730ee-1bb6-41bd-a1a8-578e3bded9a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:07:10.272438 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce730ee-1bb6-41bd-a1a8-578e3bded9a7 None admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:07:10.277332 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 472/926] 10.222.0.71 () {56 vars in 1116 bytes} [Thu Jul 28 11:07:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:07:10.283088 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22193d9e-bf88-4ea7-90bc-ab8918f9b9bc None admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:07:10.381365 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22193d9e-bf88-4ea7-90bc-ab8918f9b9bc None admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:07:10.414423 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ffd33-b20a-41b9-b57f-1cb7f1152317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:07:10.415046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ffd33-b20a-41b9-b57f-1cb7f1152317 None admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:07:10.415361 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ffd33-b20a-41b9-b57f-1cb7f1152317 None admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:07:10.415644 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ffd33-b20a-41b9-b57f-1cb7f1152317 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:07:10.416351 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ffd33-b20a-41b9-b57f-1cb7f1152317 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:07:10.417742 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ffd33-b20a-41b9-b57f-1cb7f1152317 None admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:07:10.438117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 455/927] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Jul 28 11:07:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:07:20.274484 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=30 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:07:20.433979 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:08:09.885480 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62837af-bc31-4370-b136-00d2934566f8 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:09.885981 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62837af-bc31-4370-b136-00d2934566f8 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:09.886079 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62837af-bc31-4370-b136-00d2934566f8 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:09.893051 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc73ead-e44d-4930-b3fc-13dd250d4545 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:09.893515 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc73ead-e44d-4930-b3fc-13dd250d4545 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:09.893622 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc73ead-e44d-4930-b3fc-13dd250d4545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:09.897076 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 473/928] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:08:09 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:08:09.935162 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-efc73ead-e44d-4930-b3fc-13dd250d4545 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:08:09.936689 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-efc73ead-e44d-4930-b3fc-13dd250d4545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:08:10.027561 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 456/929] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:08:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:08:10.078244 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329ff50-8540-456f-84c2-c0c6fd444df1 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:10.078546 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329ff50-8540-456f-84c2-c0c6fd444df1 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:10.078847 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329ff50-8540-456f-84c2-c0c6fd444df1 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:10.080608 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 474/930] 10.222.0.71 () {54 vars in 965 bytes} [Thu Jul 28 11:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:08:10.086923 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5cdde-041d-4511-b67b-52e23ac2fc73 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:10.087187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5cdde-041d-4511-b67b-52e23ac2fc73 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:10.087653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5cdde-041d-4511-b67b-52e23ac2fc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:10.173690 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-8ad5cdde-041d-4511-b67b-52e23ac2fc73 None None] MFA Rules not processed for user `bd087e64f5714585a53556a8dda546e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:08:10.174943 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-8ad5cdde-041d-4511-b67b-52e23ac2fc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:08:10.251829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 457/931] 10.222.0.71 () {58 vars in 1062 bytes} [Thu Jul 28 11:08:10 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:08:10.253910 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329ff50-8540-456f-84c2-c0c6fd444df1 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:08:10.277629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329ff50-8540-456f-84c2-c0c6fd444df1 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:08:10.284017 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c06b65-dd2d-4e31-8a31-fb8345798b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:08:10.284646 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c06b65-dd2d-4e31-8a31-fb8345798b7e service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:10.284935 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c06b65-dd2d-4e31-8a31-fb8345798b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:10.285796 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c06b65-dd2d-4e31-8a31-fb8345798b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:10.299955 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c06b65-dd2d-4e31-8a31-fb8345798b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:08:10.301992 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c06b65-dd2d-4e31-8a31-fb8345798b7e service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:08:10.313339 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 475/932] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:08:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:08:12.838986 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814e4fe-10ed-456c-8180-362c9a7d2017 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:12.839594 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814e4fe-10ed-456c-8180-362c9a7d2017 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:12.839594 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814e4fe-10ed-456c-8180-362c9a7d2017 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:12.840927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 458/933] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:08:12.846040 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96569061-c975-4c5b-8a7f-2015eb5f912e None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:12.846439 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96569061-c975-4c5b-8a7f-2015eb5f912e None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:12.846595 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96569061-c975-4c5b-8a7f-2015eb5f912e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:12.865420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-96569061-c975-4c5b-8a7f-2015eb5f912e None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:08:12.866600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-96569061-c975-4c5b-8a7f-2015eb5f912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:08:12.874529 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 476/934] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:08:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:08:12.914675 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814e4fe-10ed-456c-8180-362c9a7d2017 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:08:12.925208 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814e4fe-10ed-456c-8180-362c9a7d2017 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:08:12.928684 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d697e97-044a-4038-bbaf-24f97cab6172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:08:12.929286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d697e97-044a-4038-bbaf-24f97cab6172 service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:12.929573 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d697e97-044a-4038-bbaf-24f97cab6172 service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:12.929856 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d697e97-044a-4038-bbaf-24f97cab6172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:12.938803 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d697e97-044a-4038-bbaf-24f97cab6172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:08:12.940299 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d697e97-044a-4038-bbaf-24f97cab6172 service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:08:12.950587 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 459/935] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:08:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:08:15.548221 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc34cb-a22b-4baf-8007-6853374bac80 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:15.548876 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc34cb-a22b-4baf-8007-6853374bac80 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:15.548876 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc34cb-a22b-4baf-8007-6853374bac80 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:15.550115 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 477/936] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:08:15.558002 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf5c97-7fa2-44f9-a072-0d2ad8ce90d0 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:15.558527 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf5c97-7fa2-44f9-a072-0d2ad8ce90d0 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:15.558527 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf5c97-7fa2-44f9-a072-0d2ad8ce90d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:15.602077 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-18bf5c97-7fa2-44f9-a072-0d2ad8ce90d0 None None] MFA Rules not processed for user `ed549f7c8f5d4711bcb4f60dff8f3746`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:08:15.603342 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-18bf5c97-7fa2-44f9-a072-0d2ad8ce90d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:08:15.654523 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:08:15.691812 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 460/937] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:08:15 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:08:15.732360 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc34cb-a22b-4baf-8007-6853374bac80 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:08:15.743094 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc34cb-a22b-4baf-8007-6853374bac80 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:08:15.746754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb4641-c9fa-4489-8602-27ed8724248e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:08:15.747751 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb4641-c9fa-4489-8602-27ed8724248e service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:15.748342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb4641-c9fa-4489-8602-27ed8724248e service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:15.748827 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb4641-c9fa-4489-8602-27ed8724248e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:15.758565 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb4641-c9fa-4489-8602-27ed8724248e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:08:15.760255 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb4641-c9fa-4489-8602-27ed8724248e service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:08:15.771518 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 478/938] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:08:15 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:08:18.642304 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445773f-0be1-49e7-b5ff-46218f61aeae None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:18.642803 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445773f-0be1-49e7-b5ff-46218f61aeae None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:18.642803 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445773f-0be1-49e7-b5ff-46218f61aeae None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:18.644168 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 461/939] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:08:18.649300 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318ebe7-0050-459d-893a-fa9be2c1e30d None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:18.649686 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318ebe7-0050-459d-893a-fa9be2c1e30d None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:18.649849 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318ebe7-0050-459d-893a-fa9be2c1e30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:18.668372 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-2318ebe7-0050-459d-893a-fa9be2c1e30d None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:08:18.669553 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-2318ebe7-0050-459d-893a-fa9be2c1e30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:08:18.743783 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 479/940] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:08:18 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:08:18.784652 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445773f-0be1-49e7-b5ff-46218f61aeae None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:08:18.798225 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445773f-0be1-49e7-b5ff-46218f61aeae None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:08:18.802273 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bd338-bc58-4a58-a3cf-b3dfc713e84e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:08:18.802890 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bd338-bc58-4a58-a3cf-b3dfc713e84e service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:18.803174 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bd338-bc58-4a58-a3cf-b3dfc713e84e service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:18.803501 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bd338-bc58-4a58-a3cf-b3dfc713e84e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:18.812400 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bd338-bc58-4a58-a3cf-b3dfc713e84e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:08:18.813855 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bd338-bc58-4a58-a3cf-b3dfc713e84e service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:08:18.823319 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 462/941] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:08:18 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:08:21.748143 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd4cbb-26e7-48cc-abec-68e0b32a9fc1 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:21.748709 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd4cbb-26e7-48cc-abec-68e0b32a9fc1 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:21.748709 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd4cbb-26e7-48cc-abec-68e0b32a9fc1 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:21.750099 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 480/942] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:08:21.755909 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d222b5-c083-45c2-b238-f8e931cb355c None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:21.756316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d222b5-c083-45c2-b238-f8e931cb355c None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:21.756455 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d222b5-c083-45c2-b238-f8e931cb355c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:21.776172 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-42d222b5-c083-45c2-b238-f8e931cb355c None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:08:21.776825 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-42d222b5-c083-45c2-b238-f8e931cb355c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:08:21.784704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 463/943] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:08:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:08:21.823206 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd4cbb-26e7-48cc-abec-68e0b32a9fc1 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:08:21.833709 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd4cbb-26e7-48cc-abec-68e0b32a9fc1 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:08:21.837193 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ce1f8-5d28-4d53-ae2d-2eb2fbf2d03c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:08:21.837798 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ce1f8-5d28-4d53-ae2d-2eb2fbf2d03c service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:21.838081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ce1f8-5d28-4d53-ae2d-2eb2fbf2d03c service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:21.838670 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ce1f8-5d28-4d53-ae2d-2eb2fbf2d03c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:21.848288 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ce1f8-5d28-4d53-ae2d-2eb2fbf2d03c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:08:21.849793 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ce1f8-5d28-4d53-ae2d-2eb2fbf2d03c service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:08:21.859208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 481/944] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:08:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:08:24.138781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ff756-6bae-44fe-a965-a95b5a433b13 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:24.139597 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ff756-6bae-44fe-a965-a95b5a433b13 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:24.139597 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ff756-6bae-44fe-a965-a95b5a433b13 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:24.140960 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 464/945] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:08:24.146043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03333a85-6a5a-41b6-9766-c71edad6fd31 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:24.146451 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03333a85-6a5a-41b6-9766-c71edad6fd31 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:24.146724 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03333a85-6a5a-41b6-9766-c71edad6fd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:24.166050 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-03333a85-6a5a-41b6-9766-c71edad6fd31 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:08:24.167243 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-03333a85-6a5a-41b6-9766-c71edad6fd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:08:24.174980 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 482/946] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:08:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:08:24.212680 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ff756-6bae-44fe-a965-a95b5a433b13 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:08:24.223715 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ff756-6bae-44fe-a965-a95b5a433b13 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:08:24.227115 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62386b9e-af4d-4aab-b216-e35e4d3e9724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:08:24.227751 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62386b9e-af4d-4aab-b216-e35e4d3e9724 service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:24.228032 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62386b9e-af4d-4aab-b216-e35e4d3e9724 service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:24.228310 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62386b9e-af4d-4aab-b216-e35e4d3e9724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:24.237079 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62386b9e-af4d-4aab-b216-e35e4d3e9724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:08:24.239065 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62386b9e-af4d-4aab-b216-e35e4d3e9724 service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:08:24.248292 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 465/947] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:08:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:08:26.529835 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169787a-03ae-432f-b784-27d1b686dcb0 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:26.530364 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169787a-03ae-432f-b784-27d1b686dcb0 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:26.530364 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169787a-03ae-432f-b784-27d1b686dcb0 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:26.531787 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 483/948] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:08:26.537021 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03897c56-4510-40a6-9c7c-33ae21b8e254 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:26.537551 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03897c56-4510-40a6-9c7c-33ae21b8e254 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:26.537652 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03897c56-4510-40a6-9c7c-33ae21b8e254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:26.557429 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-03897c56-4510-40a6-9c7c-33ae21b8e254 None None] MFA Rules not processed for user `ed549f7c8f5d4711bcb4f60dff8f3746`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:08:26.558724 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-03897c56-4510-40a6-9c7c-33ae21b8e254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:08:26.568532 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 466/949] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:08:26 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:08:26.610543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169787a-03ae-432f-b784-27d1b686dcb0 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:08:26.621028 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169787a-03ae-432f-b784-27d1b686dcb0 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:08:26.624497 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488dbd3-92b1-4627-9580-563c1a83f955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:08:26.625110 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488dbd3-92b1-4627-9580-563c1a83f955 service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:26.625395 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488dbd3-92b1-4627-9580-563c1a83f955 service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:26.625727 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488dbd3-92b1-4627-9580-563c1a83f955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:26.635238 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488dbd3-92b1-4627-9580-563c1a83f955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:08:26.636708 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488dbd3-92b1-4627-9580-563c1a83f955 service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:08:26.647180 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 484/950] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:08:26 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:08:29.097075 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093539ef-31c5-43d8-8c46-993d686a9d37 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:29.097645 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093539ef-31c5-43d8-8c46-993d686a9d37 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:29.097645 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093539ef-31c5-43d8-8c46-993d686a9d37 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:29.099010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 467/951] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:08:29.105149 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5542a05-2759-4157-82df-728805e6cfe5 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:29.105661 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5542a05-2759-4157-82df-728805e6cfe5 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:29.105762 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5542a05-2759-4157-82df-728805e6cfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:29.125689 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-b5542a05-2759-4157-82df-728805e6cfe5 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:08:29.126918 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-b5542a05-2759-4157-82df-728805e6cfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:08:29.135049 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 485/952] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:08:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:08:29.188570 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520cc57-5ab7-47b2-8c73-538a17c76396 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:29.188857 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520cc57-5ab7-47b2-8c73-538a17c76396 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:29.189136 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520cc57-5ab7-47b2-8c73-538a17c76396 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:29.190500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 468/953] 10.222.0.71 () {54 vars in 965 bytes} [Thu Jul 28 11:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:08:29.197223 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08221c67-6647-40d4-826f-e20ff736db27 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:29.197505 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08221c67-6647-40d4-826f-e20ff736db27 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:29.197781 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08221c67-6647-40d4-826f-e20ff736db27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:29.219575 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-08221c67-6647-40d4-826f-e20ff736db27 None None] MFA Rules not processed for user `bd087e64f5714585a53556a8dda546e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:08:29.220793 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-08221c67-6647-40d4-826f-e20ff736db27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:08:29.229552 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 486/954] 10.222.0.71 () {58 vars in 1062 bytes} [Thu Jul 28 11:08:29 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:08:29.239526 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520cc57-5ab7-47b2-8c73-538a17c76396 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:08:29.250542 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520cc57-5ab7-47b2-8c73-538a17c76396 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:08:29.254249 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c20403-cf55-429c-8577-c30c1b7f7951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:08:29.254880 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c20403-cf55-429c-8577-c30c1b7f7951 service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:29.255167 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c20403-cf55-429c-8577-c30c1b7f7951 service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:29.255480 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c20403-cf55-429c-8577-c30c1b7f7951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:29.265495 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c20403-cf55-429c-8577-c30c1b7f7951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:08:29.266967 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c20403-cf55-429c-8577-c30c1b7f7951 service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:08:29.277605 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 469/955] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:08:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:08:31.798444 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56c685-9f6a-4375-91c7-8e1b318f227a None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:31.798944 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56c685-9f6a-4375-91c7-8e1b318f227a None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:31.798944 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56c685-9f6a-4375-91c7-8e1b318f227a None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:31.800803 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 487/956] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:08:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:08:31.806084 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e467091-ad31-4aa4-97dd-78b6806a6ba5 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:31.806482 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e467091-ad31-4aa4-97dd-78b6806a6ba5 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:31.806652 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e467091-ad31-4aa4-97dd-78b6806a6ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:31.825295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-9e467091-ad31-4aa4-97dd-78b6806a6ba5 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:08:31.826488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-9e467091-ad31-4aa4-97dd-78b6806a6ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:08:31.834295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 470/957] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:08:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:08:31.875519 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56c685-9f6a-4375-91c7-8e1b318f227a None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:08:31.880855 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=68 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:08:31.887518 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56c685-9f6a-4375-91c7-8e1b318f227a None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:08:31.891378 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3d6d5-d67d-4966-82e8-8ac96143484f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:08:31.891988 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3d6d5-d67d-4966-82e8-8ac96143484f service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:31.892270 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3d6d5-d67d-4966-82e8-8ac96143484f service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:31.892546 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3d6d5-d67d-4966-82e8-8ac96143484f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:31.901510 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3d6d5-d67d-4966-82e8-8ac96143484f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:08:31.902932 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3d6d5-d67d-4966-82e8-8ac96143484f service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:08:31.912916 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 488/958] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:08:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:08:34.812054 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeb3f1-e0a4-45bf-b7dc-31cd54a1062e None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:34.812567 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeb3f1-e0a4-45bf-b7dc-31cd54a1062e None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:34.812655 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeb3f1-e0a4-45bf-b7dc-31cd54a1062e None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:34.813968 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 471/959] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:08:34.819206 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e8988-ff54-4ac6-92e0-b55db21cf6d4 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:34.819658 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e8988-ff54-4ac6-92e0-b55db21cf6d4 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:34.819805 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e8988-ff54-4ac6-92e0-b55db21cf6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:34.838714 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-251e8988-ff54-4ac6-92e0-b55db21cf6d4 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:08:34.839966 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-251e8988-ff54-4ac6-92e0-b55db21cf6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:08:34.848626 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 489/960] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:08:34 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:08:34.886386 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eeb3f1-e0a4-45bf-b7dc-31cd54a1062e None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:08:34.897325 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eeb3f1-e0a4-45bf-b7dc-31cd54a1062e None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:08:34.901032 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c14805-b33f-457f-8d23-bf0774218492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:08:34.901635 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14805-b33f-457f-8d23-bf0774218492 service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:34.901911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14805-b33f-457f-8d23-bf0774218492 service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:34.902183 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14805-b33f-457f-8d23-bf0774218492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:34.911682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c14805-b33f-457f-8d23-bf0774218492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:08:34.913162 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c14805-b33f-457f-8d23-bf0774218492 service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:08:34.922833 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 472/961] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:08:34 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:08:39.268159 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf710e-9160-43d4-b31f-8f7e8de4f98d None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:39.268707 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf710e-9160-43d4-b31f-8f7e8de4f98d None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:39.268707 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf710e-9160-43d4-b31f-8f7e8de4f98d None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:39.270672 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 490/962] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:08:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:08:39.275900 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11407c63-ccaa-4fbe-b55b-6299c43365b0 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:39.276372 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11407c63-ccaa-4fbe-b55b-6299c43365b0 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:39.276454 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11407c63-ccaa-4fbe-b55b-6299c43365b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:39.295132 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-11407c63-ccaa-4fbe-b55b-6299c43365b0 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:08:39.296352 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-11407c63-ccaa-4fbe-b55b-6299c43365b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:08:39.306156 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 473/963] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:08:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:08:39.345750 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf710e-9160-43d4-b31f-8f7e8de4f98d None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:08:39.356414 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf710e-9160-43d4-b31f-8f7e8de4f98d None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:08:39.359800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73993d-af58-4381-b488-2ff9205df4f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:08:39.360407 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73993d-af58-4381-b488-2ff9205df4f7 service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:39.360689 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73993d-af58-4381-b488-2ff9205df4f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:39.360960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73993d-af58-4381-b488-2ff9205df4f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:39.370023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73993d-af58-4381-b488-2ff9205df4f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:08:39.371484 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73993d-af58-4381-b488-2ff9205df4f7 service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:08:39.381587 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 491/964] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:08:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:08:42.287370 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff0197-5290-4c88-ae14-68737f9f0f4e None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:42.287962 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff0197-5290-4c88-ae14-68737f9f0f4e None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:42.287962 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff0197-5290-4c88-ae14-68737f9f0f4e None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:42.289269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 474/965] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:08:42.294628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5657487-ba54-4b80-bb35-c6937b6550e0 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:42.295056 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5657487-ba54-4b80-bb35-c6937b6550e0 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:42.295344 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5657487-ba54-4b80-bb35-c6937b6550e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:42.314666 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-c5657487-ba54-4b80-bb35-c6937b6550e0 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:08:42.316459 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-c5657487-ba54-4b80-bb35-c6937b6550e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:08:42.324431 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 492/966] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:08:42 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:08:42.362964 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff0197-5290-4c88-ae14-68737f9f0f4e None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:08:42.373756 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff0197-5290-4c88-ae14-68737f9f0f4e None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:08:42.377459 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664e04b-1f6e-4194-88bb-79d88ea71ef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:08:42.378566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664e04b-1f6e-4194-88bb-79d88ea71ef9 service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:42.378847 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664e04b-1f6e-4194-88bb-79d88ea71ef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:42.379123 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664e04b-1f6e-4194-88bb-79d88ea71ef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:42.388763 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664e04b-1f6e-4194-88bb-79d88ea71ef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:08:42.390470 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664e04b-1f6e-4194-88bb-79d88ea71ef9 service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:08:42.402286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 475/967] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:08:42 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:08:46.610481 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a7522-3ab9-407e-8013-4b5dc2c708ff None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:46.611024 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a7522-3ab9-407e-8013-4b5dc2c708ff None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:46.611024 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a7522-3ab9-407e-8013-4b5dc2c708ff None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:46.612450 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 493/968] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:08:46.617779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21a312-f7a2-490c-a1f9-e92ecd03facd None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:46.618239 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21a312-f7a2-490c-a1f9-e92ecd03facd None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:46.618339 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21a312-f7a2-490c-a1f9-e92ecd03facd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:46.625723 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=54 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:08:46.640402 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-db21a312-f7a2-490c-a1f9-e92ecd03facd None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:08:46.641592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-db21a312-f7a2-490c-a1f9-e92ecd03facd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:08:46.649936 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 476/969] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:08:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:08:46.689540 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a7522-3ab9-407e-8013-4b5dc2c708ff None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:08:46.701241 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a7522-3ab9-407e-8013-4b5dc2c708ff None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:08:46.704836 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755809c9-5a27-425d-84a7-651939c22481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:08:46.705459 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755809c9-5a27-425d-84a7-651939c22481 service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:46.705747 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755809c9-5a27-425d-84a7-651939c22481 service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:46.706628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755809c9-5a27-425d-84a7-651939c22481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:46.716246 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755809c9-5a27-425d-84a7-651939c22481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:08:46.717690 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755809c9-5a27-425d-84a7-651939c22481 service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:08:46.727154 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 494/970] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:08:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 11:08:52.282712 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080f5d1-4fa6-4094-9510-8a8f118a1ea5 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:52.283695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080f5d1-4fa6-4094-9510-8a8f118a1ea5 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:52.284768 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080f5d1-4fa6-4094-9510-8a8f118a1ea5 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:52.286405 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 477/971] 10.222.0.71 () {54 vars in 921 bytes} [Thu Jul 28 11:08:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:08:52.292783 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf7749-a969-4569-91e8-fe6fe8bb9b94 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:52.293800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf7749-a969-4569-91e8-fe6fe8bb9b94 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:52.294554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf7749-a969-4569-91e8-fe6fe8bb9b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:52.386317 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-6bdf7749-a969-4569-91e8-fe6fe8bb9b94 None None] MFA Rules not processed for user `8f4cb7d2680d4eb99a7328a54fcfd351`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:08:52.391759 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-6bdf7749-a969-4569-91e8-fe6fe8bb9b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:08:52.475344 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 495/972] 10.222.0.71 () {58 vars in 1018 bytes} [Thu Jul 28 11:08:52 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:08:56.635490 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=2 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:08:57.046991 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39f99e-db7e-4fe6-af50-8ef875ef1623 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:57.047182 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39f99e-db7e-4fe6-af50-8ef875ef1623 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:57.047534 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39f99e-db7e-4fe6-af50-8ef875ef1623 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:57.048852 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 478/973] 10.222.0.71 () {54 vars in 921 bytes} [Thu Jul 28 11:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:08:57.054624 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c172a-4ac1-4ce8-9dac-d7e7b2a8536f None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:57.055658 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c172a-4ac1-4ce8-9dac-d7e7b2a8536f None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:57.056260 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c172a-4ac1-4ce8-9dac-d7e7b2a8536f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:57.079056 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-6e3c172a-4ac1-4ce8-9dac-d7e7b2a8536f None None] MFA Rules not processed for user `8f4cb7d2680d4eb99a7328a54fcfd351`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:08:57.081532 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-6e3c172a-4ac1-4ce8-9dac-d7e7b2a8536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:08:57.097953 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 496/974] 10.222.0.71 () {58 vars in 1018 bytes} [Thu Jul 28 11:08:57 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:08:58.474484 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3299a0e-ae57-4f8e-ad50-f0a4a8d23e41 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:58.475023 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3299a0e-ae57-4f8e-ad50-f0a4a8d23e41 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:58.475023 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3299a0e-ae57-4f8e-ad50-f0a4a8d23e41 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:58.476378 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 479/975] 10.222.0.71 () {54 vars in 921 bytes} [Thu Jul 28 11:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:08:58.481691 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97e04e-68d9-4452-ab84-bf9490ff4d84 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:08:58.482213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97e04e-68d9-4452-ab84-bf9490ff4d84 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:08:58.482435 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97e04e-68d9-4452-ab84-bf9490ff4d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:08:58.502536 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-fa97e04e-68d9-4452-ab84-bf9490ff4d84 None None] MFA Rules not processed for user `8f4cb7d2680d4eb99a7328a54fcfd351`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:08:58.503734 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-fa97e04e-68d9-4452-ab84-bf9490ff4d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:08:58.512442 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 497/976] 10.222.0.71 () {58 vars in 1018 bytes} [Thu Jul 28 11:08:58 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:02.556657 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7526c7-0e4a-4375-a67b-3a5cd71140fc None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:02.557219 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7526c7-0e4a-4375-a67b-3a5cd71140fc None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:02.557219 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7526c7-0e4a-4375-a67b-3a5cd71140fc None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:02.558528 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 480/977] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:02.563679 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5f50f-4307-4331-93b4-10807c043e95 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:02.564069 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5f50f-4307-4331-93b4-10807c043e95 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:02.564242 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5f50f-4307-4331-93b4-10807c043e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:02.572619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=69 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:09:02.586860 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-bab5f50f-4307-4331-93b4-10807c043e95 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:02.588088 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-bab5f50f-4307-4331-93b4-10807c043e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:02.596034 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 498/978] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:09:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:02.655626 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80580c60-012a-4ef6-9fe7-4f69b27b42d2 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:02.655918 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80580c60-012a-4ef6-9fe7-4f69b27b42d2 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:02.656201 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80580c60-012a-4ef6-9fe7-4f69b27b42d2 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:02.657523 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 481/979] 10.222.0.71 () {54 vars in 962 bytes} [Thu Jul 28 11:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:02.667785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffe1ce-6b41-4c2d-92cc-569b8e6991d9 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:02.671629 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffe1ce-6b41-4c2d-92cc-569b8e6991d9 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:02.672012 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffe1ce-6b41-4c2d-92cc-569b8e6991d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:02.737316 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-ceffe1ce-6b41-4c2d-92cc-569b8e6991d9 None None] MFA Rules not processed for user `2bf7f66ba696444f8055a498e292a182`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:02.738664 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-ceffe1ce-6b41-4c2d-92cc-569b8e6991d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:02.812076 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 499/980] 10.222.0.71 () {58 vars in 1059 bytes} [Thu Jul 28 11:09:02 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:02.819829 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80580c60-012a-4ef6-9fe7-4f69b27b42d2 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:02.834363 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80580c60-012a-4ef6-9fe7-4f69b27b42d2 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:02.839503 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea9db7-06c9-4bdb-8712-f269d4a609ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:02.840168 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea9db7-06c9-4bdb-8712-f269d4a609ba service nova] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:02.840455 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea9db7-06c9-4bdb-8712-f269d4a609ba service nova] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:02.840734 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea9db7-06c9-4bdb-8712-f269d4a609ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:02.850993 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea9db7-06c9-4bdb-8712-f269d4a609ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:02.852779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea9db7-06c9-4bdb-8712-f269d4a609ba service nova] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:02.862699 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 482/981] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:05.317582 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562860e-51b8-4c5a-8558-76a403001e88 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:05.318104 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562860e-51b8-4c5a-8558-76a403001e88 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:05.318184 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562860e-51b8-4c5a-8558-76a403001e88 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:05.319734 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 500/982] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:05.324779 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a946de-7a0c-4407-9e50-5313b12ecae7 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:05.325213 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a946de-7a0c-4407-9e50-5313b12ecae7 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:05.325331 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a946de-7a0c-4407-9e50-5313b12ecae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:05.345806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-49a946de-7a0c-4407-9e50-5313b12ecae7 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:05.347735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-49a946de-7a0c-4407-9e50-5313b12ecae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:05.356817 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 483/983] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:09:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:09:05.408670 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562860e-51b8-4c5a-8558-76a403001e88 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:05.422304 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562860e-51b8-4c5a-8558-76a403001e88 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:05.427385 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9808fe-4f2a-4e6e-aa6a-c28ce02204f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:05.428027 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9808fe-4f2a-4e6e-aa6a-c28ce02204f9 service nova] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:05.428315 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9808fe-4f2a-4e6e-aa6a-c28ce02204f9 service nova] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:05.428631 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9808fe-4f2a-4e6e-aa6a-c28ce02204f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:05.437256 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9808fe-4f2a-4e6e-aa6a-c28ce02204f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:05.438754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9808fe-4f2a-4e6e-aa6a-c28ce02204f9 service nova] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:05.449385 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 501/984] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:08.033476 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4e9ba-8ede-4318-85e5-cbe7a6fe3725 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:08.033930 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4e9ba-8ede-4318-85e5-cbe7a6fe3725 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:08.034052 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4e9ba-8ede-4318-85e5-cbe7a6fe3725 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:08.035630 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 484/985] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:08.042124 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e7089-854e-4f25-8927-9791f2c59526 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:08.042704 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e7089-854e-4f25-8927-9791f2c59526 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:08.042981 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e7089-854e-4f25-8927-9791f2c59526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:08.069410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-de9e7089-854e-4f25-8927-9791f2c59526 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:08.070628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-de9e7089-854e-4f25-8927-9791f2c59526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:08.084904 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 502/986] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:09:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:08.156980 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948a556-63ba-464f-94e7-908e0d12acad None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:08.157794 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948a556-63ba-464f-94e7-908e0d12acad None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:08.158274 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948a556-63ba-464f-94e7-908e0d12acad None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:08.160215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 485/987] 10.222.0.71 () {54 vars in 962 bytes} [Thu Jul 28 11:09:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:08.165839 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288cd20-9f0a-41d2-b143-729eaa13d1c7 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:08.166394 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288cd20-9f0a-41d2-b143-729eaa13d1c7 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:08.166878 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288cd20-9f0a-41d2-b143-729eaa13d1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:08.190638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-4288cd20-9f0a-41d2-b143-729eaa13d1c7 None None] MFA Rules not processed for user `2bf7f66ba696444f8055a498e292a182`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:08.191902 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-4288cd20-9f0a-41d2-b143-729eaa13d1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:08.203828 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 503/988] 10.222.0.71 () {58 vars in 1059 bytes} [Thu Jul 28 11:09:08 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:08.211971 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948a556-63ba-464f-94e7-908e0d12acad None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:08.229751 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948a556-63ba-464f-94e7-908e0d12acad None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:08.235749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ba56b-e705-4f34-a99f-093d64346189 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:08.237352 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba56b-e705-4f34-a99f-093d64346189 service nova] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:08.237839 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba56b-e705-4f34-a99f-093d64346189 service nova] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:08.238297 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba56b-e705-4f34-a99f-093d64346189 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:08.250567 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ba56b-e705-4f34-a99f-093d64346189 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:08.253704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ba56b-e705-4f34-a99f-093d64346189 service nova] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:08.264638 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 486/989] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:10.673552 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0f30f-8f2a-4f32-a874-ff94b3bf4531 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:10.675321 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0f30f-8f2a-4f32-a874-ff94b3bf4531 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:10.675868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0f30f-8f2a-4f32-a874-ff94b3bf4531 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:10.678001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 504/990] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:09:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:10.683909 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6750602-d319-43ea-814d-57ea6cdb87e0 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:10.684780 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6750602-d319-43ea-814d-57ea6cdb87e0 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:10.685290 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6750602-d319-43ea-814d-57ea6cdb87e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:10.705883 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-c6750602-d319-43ea-814d-57ea6cdb87e0 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:10.707499 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-c6750602-d319-43ea-814d-57ea6cdb87e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:10.723787 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 487/991] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:09:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:10.765065 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0f30f-8f2a-4f32-a874-ff94b3bf4531 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:10.780733 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0f30f-8f2a-4f32-a874-ff94b3bf4531 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:10.787298 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f31d7a-81fd-4976-819c-512c87d661ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:10.788346 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31d7a-81fd-4976-819c-512c87d661ff service nova] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:10.788838 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31d7a-81fd-4976-819c-512c87d661ff service nova] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:10.789423 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31d7a-81fd-4976-819c-512c87d661ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:10.798567 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f31d7a-81fd-4976-819c-512c87d661ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:10.801010 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f31d7a-81fd-4976-819c-512c87d661ff service nova] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:10.825851 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 505/992] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:12.648661 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5fad-a150-4874-81d3-007d8ce7e4a5 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:12.649169 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5fad-a150-4874-81d3-007d8ce7e4a5 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:12.649265 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5fad-a150-4874-81d3-007d8ce7e4a5 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:12.654922 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 488/993] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:09:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:12.656254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81b914-e3da-462c-9a30-17b451363015 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:12.656683 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81b914-e3da-462c-9a30-17b451363015 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:12.656887 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81b914-e3da-462c-9a30-17b451363015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:12.704120 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-df81b914-e3da-462c-9a30-17b451363015 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:12.706244 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-df81b914-e3da-462c-9a30-17b451363015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:12.715492 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 506/994] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:09:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:09:13.029080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eaa2d-7d5a-4fac-922d-4f019791aad6 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:13.029080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eaa2d-7d5a-4fac-922d-4f019791aad6 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:13.029080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eaa2d-7d5a-4fac-922d-4f019791aad6 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:13.031031 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 489/995] 10.222.0.71 () {54 vars in 964 bytes} [Thu Jul 28 11:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:13.037429 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e655c-2b9d-4124-98ba-6a346a156f9d None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:13.037818 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e655c-2b9d-4124-98ba-6a346a156f9d None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:13.038102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e655c-2b9d-4124-98ba-6a346a156f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:13.079434 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-200e655c-2b9d-4124-98ba-6a346a156f9d None None] MFA Rules not processed for user `a13ee61417bf4b1696004d6d73cf2299`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:13.080679 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-200e655c-2b9d-4124-98ba-6a346a156f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:13.150641 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 507/996] 10.222.0.71 () {58 vars in 1061 bytes} [Thu Jul 28 11:09:13 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:13.158944 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532eaa2d-7d5a-4fac-922d-4f019791aad6 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:13.170905 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532eaa2d-7d5a-4fac-922d-4f019791aad6 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:13.175601 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172333a6-bb92-4fe4-9811-c625c94c8c78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a13ee61417bf4b1696004d6d73cf2299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:13.176492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172333a6-bb92-4fe4-9811-c625c94c8c78 service cinder] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:13.176986 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172333a6-bb92-4fe4-9811-c625c94c8c78 service cinder] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:13.177479 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172333a6-bb92-4fe4-9811-c625c94c8c78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:13.187792 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172333a6-bb92-4fe4-9811-c625c94c8c78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:13.189455 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172333a6-bb92-4fe4-9811-c625c94c8c78 service cinder] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:13.199915 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 490/997] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:13.391503 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206b2d1-f334-441c-a25e-a3be6e94eb69 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:13.391807 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206b2d1-f334-441c-a25e-a3be6e94eb69 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:13.392070 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206b2d1-f334-441c-a25e-a3be6e94eb69 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:13.394105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 508/998] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:09:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:13.399159 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e267aa7-f86f-4865-996a-0b75987b408c None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:13.399478 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e267aa7-f86f-4865-996a-0b75987b408c None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:13.399758 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e267aa7-f86f-4865-996a-0b75987b408c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:13.419024 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-6e267aa7-f86f-4865-996a-0b75987b408c None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:13.420240 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-6e267aa7-f86f-4865-996a-0b75987b408c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:13.428703 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 491/999] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:09:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:13.474018 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206b2d1-f334-441c-a25e-a3be6e94eb69 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:13.490081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206b2d1-f334-441c-a25e-a3be6e94eb69 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:13.495026 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e8d9c-1ca2-4cbf-9e59-1c88cfead5ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:13.495701 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e8d9c-1ca2-4cbf-9e59-1c88cfead5ad service nova] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:13.495992 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e8d9c-1ca2-4cbf-9e59-1c88cfead5ad service nova] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:13.496275 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e8d9c-1ca2-4cbf-9e59-1c88cfead5ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:13.505306 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e8d9c-1ca2-4cbf-9e59-1c88cfead5ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:13.506908 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e8d9c-1ca2-4cbf-9e59-1c88cfead5ad service nova] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:13.511103 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:09:13.524102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 509/1000] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:15.810274 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc11a1-75c9-4df1-b0cd-6ea042787ab2 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:15.810772 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc11a1-75c9-4df1-b0cd-6ea042787ab2 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:15.810884 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc11a1-75c9-4df1-b0cd-6ea042787ab2 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:15.812217 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 492/1001] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:15.818229 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c08804-9fe5-41ea-be98-f668eb981265 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:15.819048 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c08804-9fe5-41ea-be98-f668eb981265 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:15.819505 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c08804-9fe5-41ea-be98-f668eb981265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:15.840268 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-d5c08804-9fe5-41ea-be98-f668eb981265 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:15.842531 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-d5c08804-9fe5-41ea-be98-f668eb981265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:15.855941 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 510/1002] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:09:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:15.906368 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc11a1-75c9-4df1-b0cd-6ea042787ab2 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:15.922608 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc11a1-75c9-4df1-b0cd-6ea042787ab2 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:15.927647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce889837-3986-43b8-a18e-a2aa9300d41e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:15.928259 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce889837-3986-43b8-a18e-a2aa9300d41e service nova] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:15.928534 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce889837-3986-43b8-a18e-a2aa9300d41e service nova] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:15.930650 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce889837-3986-43b8-a18e-a2aa9300d41e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:15.938315 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce889837-3986-43b8-a18e-a2aa9300d41e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:15.940697 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce889837-3986-43b8-a18e-a2aa9300d41e service nova] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:15.951477 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 493/1003] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:18.238600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a046-c704-44e1-bdec-7c2de0c0f5c7 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:18.239446 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a046-c704-44e1-bdec-7c2de0c0f5c7 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:18.239446 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a046-c704-44e1-bdec-7c2de0c0f5c7 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:18.240837 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 511/1004] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:18.246046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432a8dc-fb6b-46fb-ab00-242d2032845d None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:18.246452 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432a8dc-fb6b-46fb-ab00-242d2032845d None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:18.246614 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432a8dc-fb6b-46fb-ab00-242d2032845d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:18.269050 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-6432a8dc-fb6b-46fb-ab00-242d2032845d None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:18.270746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-6432a8dc-fb6b-46fb-ab00-242d2032845d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:18.278771 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 494/1005] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:09:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:18.322016 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2a046-c704-44e1-bdec-7c2de0c0f5c7 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:18.336432 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2a046-c704-44e1-bdec-7c2de0c0f5c7 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:18.341461 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e47dd-0dd9-4aba-8455-dd5db4418f09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:18.342159 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e47dd-0dd9-4aba-8455-dd5db4418f09 service nova] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:18.342517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e47dd-0dd9-4aba-8455-dd5db4418f09 service nova] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:18.342861 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e47dd-0dd9-4aba-8455-dd5db4418f09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:18.351555 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e47dd-0dd9-4aba-8455-dd5db4418f09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:18.353219 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e47dd-0dd9-4aba-8455-dd5db4418f09 service nova] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:18.363108 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 512/1006] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:20.620632 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b85c2-34cd-4e6c-829f-43296847b712 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:20.621230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b85c2-34cd-4e6c-829f-43296847b712 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:20.621230 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b85c2-34cd-4e6c-829f-43296847b712 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:20.622763 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 495/1007] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:20.629104 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8853265-9311-45ca-8703-b03a756d2764 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:20.629674 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8853265-9311-45ca-8703-b03a756d2764 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:20.629674 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8853265-9311-45ca-8703-b03a756d2764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:20.652141 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-b8853265-9311-45ca-8703-b03a756d2764 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:20.654080 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-b8853265-9311-45ca-8703-b03a756d2764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:20.664789 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 513/1008] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:09:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:20.711788 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b85c2-34cd-4e6c-829f-43296847b712 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:20.726883 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b85c2-34cd-4e6c-829f-43296847b712 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:20.732195 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a225367-96c1-45f8-8202-bf2a06e57eb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:20.732883 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a225367-96c1-45f8-8202-bf2a06e57eb6 service nova] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:20.733262 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a225367-96c1-45f8-8202-bf2a06e57eb6 service nova] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:20.733611 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a225367-96c1-45f8-8202-bf2a06e57eb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:20.743392 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a225367-96c1-45f8-8202-bf2a06e57eb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:20.744993 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a225367-96c1-45f8-8202-bf2a06e57eb6 service nova] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:20.756675 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 496/1009] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:23.527863 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be10712-8eb0-4682-856f-403131d445cf None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:23.528954 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be10712-8eb0-4682-856f-403131d445cf None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:23.528954 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be10712-8eb0-4682-856f-403131d445cf None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:23.530319 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 514/1010] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:09:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:23.536673 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55ae9c-f05a-4a89-bf24-5a452d74a2f5 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:23.537336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55ae9c-f05a-4a89-bf24-5a452d74a2f5 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:23.537336 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55ae9c-f05a-4a89-bf24-5a452d74a2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:23.557896 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-9a55ae9c-f05a-4a89-bf24-5a452d74a2f5 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:23.559170 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-9a55ae9c-f05a-4a89-bf24-5a452d74a2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:23.567610 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 497/1011] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:09:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:23.613744 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be10712-8eb0-4682-856f-403131d445cf None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:23.628308 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be10712-8eb0-4682-856f-403131d445cf None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:23.633399 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1596d7d-50fa-4ac9-83b3-aebf6d47fd81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:23.634015 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1596d7d-50fa-4ac9-83b3-aebf6d47fd81 service nova] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:23.634307 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1596d7d-50fa-4ac9-83b3-aebf6d47fd81 service nova] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:23.634584 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1596d7d-50fa-4ac9-83b3-aebf6d47fd81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:23.643590 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1596d7d-50fa-4ac9-83b3-aebf6d47fd81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:23.645270 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1596d7d-50fa-4ac9-83b3-aebf6d47fd81 service nova] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:23.655921 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 515/1012] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:26.593634 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad5dd5-19dd-4186-91f4-a63d39786a24 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:26.594288 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad5dd5-19dd-4186-91f4-a63d39786a24 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:26.594400 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad5dd5-19dd-4186-91f4-a63d39786a24 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:26.596180 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 498/1013] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:09:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:26.602321 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6e9f3-0a98-4d25-a379-921aaf0223cb None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:26.602899 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6e9f3-0a98-4d25-a379-921aaf0223cb None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:26.603012 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6e9f3-0a98-4d25-a379-921aaf0223cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:26.622834 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-93a6e9f3-0a98-4d25-a379-921aaf0223cb None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:26.624121 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-93a6e9f3-0a98-4d25-a379-921aaf0223cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:26.632717 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 516/1014] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:09:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:26.682011 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad5dd5-19dd-4186-91f4-a63d39786a24 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:26.690539 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=46 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:09:26.699297 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad5dd5-19dd-4186-91f4-a63d39786a24 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:26.705109 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332b19c-ac8e-493e-a1c8-6095971cf3a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:26.705684 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332b19c-ac8e-493e-a1c8-6095971cf3a9 service nova] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:26.705965 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332b19c-ac8e-493e-a1c8-6095971cf3a9 service nova] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:26.706254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332b19c-ac8e-493e-a1c8-6095971cf3a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:26.715340 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332b19c-ac8e-493e-a1c8-6095971cf3a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:26.716976 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332b19c-ac8e-493e-a1c8-6095971cf3a9 service nova] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:26.726981 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 499/1015] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:29.151554 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ff914-adf8-4131-9266-d83bb57287bc None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:29.152273 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee51d64-63a8-4dbb-9bce-83567ef5cf12 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:29.152273 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee51d64-63a8-4dbb-9bce-83567ef5cf12 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:29.152788 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ff914-adf8-4131-9266-d83bb57287bc None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:29.152788 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ff914-adf8-4131-9266-d83bb57287bc None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:29.152965 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee51d64-63a8-4dbb-9bce-83567ef5cf12 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:29.153592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 500/1017] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:29.153721 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 517/1017] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:29.158474 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52099fef-7026-46e6-a275-053513d58d25 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:29.158617 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26890f-e8c3-42f5-9ac9-32c45540e973 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:29.158785 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52099fef-7026-46e6-a275-053513d58d25 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:29.158898 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26890f-e8c3-42f5-9ac9-32c45540e973 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:29.159051 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52099fef-7026-46e6-a275-053513d58d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:29.159152 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26890f-e8c3-42f5-9ac9-32c45540e973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:29.178426 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-52099fef-7026-46e6-a275-053513d58d25 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:29.179690 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-52099fef-7026-46e6-a275-053513d58d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:29.182409 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-ab26890f-e8c3-42f5-9ac9-32c45540e973 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:29.183628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-ab26890f-e8c3-42f5-9ac9-32c45540e973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:29.187587 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 501/1018] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:09:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:29.192166 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 518/1019] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:09:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:09:29.233581 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52099fef-7026-46e6-a275-053513d58d25 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:29.251787 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52099fef-7026-46e6-a275-053513d58d25 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:29.257015 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a50ba8-84b0-41e9-a89c-681259beb8cc None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:29.257302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a50ba8-84b0-41e9-a89c-681259beb8cc None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:29.257585 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a50ba8-84b0-41e9-a89c-681259beb8cc None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:29.258929 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8742c-2b33-4acd-90cc-f78cabb48a0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:29.259123 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 519/1020] 10.222.0.71 () {54 vars in 966 bytes} [Thu Jul 28 11:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:09:29.259772 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8742c-2b33-4acd-90cc-f78cabb48a0b service nova] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:29.260184 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8742c-2b33-4acd-90cc-f78cabb48a0b service nova] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:29.260573 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8742c-2b33-4acd-90cc-f78cabb48a0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:29.263743 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ffc78-7c13-4bbe-9e27-d7e39068d41e None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:29.264039 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ffc78-7c13-4bbe-9e27-d7e39068d41e None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:29.264601 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ffc78-7c13-4bbe-9e27-d7e39068d41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:29.270073 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8742c-2b33-4acd-90cc-f78cabb48a0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:29.271738 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8742c-2b33-4acd-90cc-f78cabb48a0b service nova] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:29.281533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 502/1021] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:29.305985 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-db0ffc78-7c13-4bbe-9e27-d7e39068d41e None None] MFA Rules not processed for user `51f33b105ddb4c81a9ead57fd2d888ac`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:29.307215 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-db0ffc78-7c13-4bbe-9e27-d7e39068d41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:29.377546 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 520/1022] 10.222.0.71 () {58 vars in 1063 bytes} [Thu Jul 28 11:09:29 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:09:29.385490 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8742c-2b33-4acd-90cc-f78cabb48a0b service nova] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:29.396322 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8742c-2b33-4acd-90cc-f78cabb48a0b service nova] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:29.400018 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b82db-67ac-4eb2-9c4b-a63c46ce1c50 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f33b105ddb4c81a9ead57fd2d888ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:29.400682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b82db-67ac-4eb2-9c4b-a63c46ce1c50 service glance] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:29.400945 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b82db-67ac-4eb2-9c4b-a63c46ce1c50 service glance] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:29.401223 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b82db-67ac-4eb2-9c4b-a63c46ce1c50 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:29.414041 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b82db-67ac-4eb2-9c4b-a63c46ce1c50 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:29.414376 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b82db-67ac-4eb2-9c4b-a63c46ce1c50 service glance] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:29.425861 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 503/1023] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:31.574312 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628685ba-6c39-4d4d-9847-ce5d4dd297c6 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:31.574959 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628685ba-6c39-4d4d-9847-ce5d4dd297c6 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:31.574959 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628685ba-6c39-4d4d-9847-ce5d4dd297c6 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:31.576374 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 521/1024] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:31.581874 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb2396-d113-41b7-948a-22d4dbe5c2c6 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:31.582393 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb2396-d113-41b7-948a-22d4dbe5c2c6 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:31.582393 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb2396-d113-41b7-948a-22d4dbe5c2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:31.612549 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-1adb2396-d113-41b7-948a-22d4dbe5c2c6 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:31.614654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-1adb2396-d113-41b7-948a-22d4dbe5c2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:31.626046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 504/1025] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:09:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:31.672673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628685ba-6c39-4d4d-9847-ce5d4dd297c6 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:31.686706 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628685ba-6c39-4d4d-9847-ce5d4dd297c6 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:31.694638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75dc8f-b6b2-42d5-9dd8-c0c573cfde66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:31.695281 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75dc8f-b6b2-42d5-9dd8-c0c573cfde66 service nova] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:31.695576 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75dc8f-b6b2-42d5-9dd8-c0c573cfde66 service nova] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:31.695850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75dc8f-b6b2-42d5-9dd8-c0c573cfde66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:31.706667 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75dc8f-b6b2-42d5-9dd8-c0c573cfde66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:31.708818 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75dc8f-b6b2-42d5-9dd8-c0c573cfde66 service nova] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:31.721524 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 522/1026] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:41.601420 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=23 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:09:41.716635 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=64 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:09:44.679831 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eb268-1d3c-4bb7-a5fb-bde6596677ef None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:44.680488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eb268-1d3c-4bb7-a5fb-bde6596677ef None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:44.680488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eb268-1d3c-4bb7-a5fb-bde6596677ef None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:44.681782 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 505/1027] 10.222.0.71 () {54 vars in 918 bytes} [Thu Jul 28 11:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:09:44.686825 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa7dc0-3828-4724-9955-09bd3dca1b38 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:44.687294 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa7dc0-3828-4724-9955-09bd3dca1b38 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:44.687409 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa7dc0-3828-4724-9955-09bd3dca1b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:44.707118 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-c0aa7dc0-3828-4724-9955-09bd3dca1b38 None None] MFA Rules not processed for user `8f4cb7d2680d4eb99a7328a54fcfd351`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:44.708345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-c0aa7dc0-3828-4724-9955-09bd3dca1b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:44.716738 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 523/1028] 10.222.0.71 () {58 vars in 1015 bytes} [Thu Jul 28 11:09:44 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:44.731916 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f42b7-63b8-4070-9643-e52deb6bd23a None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:44.732205 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f42b7-63b8-4070-9643-e52deb6bd23a None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:44.732486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f42b7-63b8-4070-9643-e52deb6bd23a None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:44.733798 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 506/1029] 10.222.0.71 () {54 vars in 918 bytes} [Thu Jul 28 11:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:44.739067 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d9505-820a-4202-b79c-ab2dd2d2f68c None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:44.739381 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d9505-820a-4202-b79c-ab2dd2d2f68c None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:44.739661 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d9505-820a-4202-b79c-ab2dd2d2f68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:44.759290 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-0a3d9505-820a-4202-b79c-ab2dd2d2f68c None None] MFA Rules not processed for user `2bf7f66ba696444f8055a498e292a182`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:44.760488 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-0a3d9505-820a-4202-b79c-ab2dd2d2f68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:44.769194 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 524/1030] 10.222.0.71 () {58 vars in 1015 bytes} [Thu Jul 28 11:09:44 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:09:47.503483 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f98f2-fd3e-43ef-b982-fb33f017955b None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:47.504240 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f98f2-fd3e-43ef-b982-fb33f017955b None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:47.504240 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f98f2-fd3e-43ef-b982-fb33f017955b None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:47.505670 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 507/1031] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 11:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:47.511733 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367b7ea-c45e-48a6-bd14-ecf120452350 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:47.512277 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367b7ea-c45e-48a6-bd14-ecf120452350 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:47.512277 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367b7ea-c45e-48a6-bd14-ecf120452350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:47.532114 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-3367b7ea-c45e-48a6-bd14-ecf120452350 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:47.533833 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-3367b7ea-c45e-48a6-bd14-ecf120452350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:47.541707 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 525/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 11:09:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:47.585398 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f98f2-fd3e-43ef-b982-fb33f017955b None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:47.599630 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f98f2-fd3e-43ef-b982-fb33f017955b None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:47.604535 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b29d5f-cd48-426e-8026-23fa89e1eb43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:47.605132 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b29d5f-cd48-426e-8026-23fa89e1eb43 service nova] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:47.605411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b29d5f-cd48-426e-8026-23fa89e1eb43 service nova] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:47.605685 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b29d5f-cd48-426e-8026-23fa89e1eb43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:47.614488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b29d5f-cd48-426e-8026-23fa89e1eb43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:47.616137 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b29d5f-cd48-426e-8026-23fa89e1eb43 service nova] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:47.625508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 508/1033] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:48.598445 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7c19-6686-4cf2-a1a9-584d42e27dac None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:48.599012 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7c19-6686-4cf2-a1a9-584d42e27dac None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:48.599012 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7c19-6686-4cf2-a1a9-584d42e27dac None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:48.600376 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 526/1034] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 11:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:48.605155 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec788b9-c1af-4bee-8525-134772d17a03 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:48.605576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec788b9-c1af-4bee-8525-134772d17a03 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:48.605739 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec788b9-c1af-4bee-8525-134772d17a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:48.625286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-6ec788b9-c1af-4bee-8525-134772d17a03 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:48.627185 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-6ec788b9-c1af-4bee-8525-134772d17a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:48.634955 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 509/1035] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 11:09:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:09:48.851890 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a7c19-6686-4cf2-a1a9-584d42e27dac None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:48.865118 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a7c19-6686-4cf2-a1a9-584d42e27dac None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:48.870082 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe882b-3281-4e89-ba3c-087477b85369 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:48.870687 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe882b-3281-4e89-ba3c-087477b85369 service nova] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:48.870970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe882b-3281-4e89-ba3c-087477b85369 service nova] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:48.871248 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe882b-3281-4e89-ba3c-087477b85369 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:48.879826 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe882b-3281-4e89-ba3c-087477b85369 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:48.881344 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe882b-3281-4e89-ba3c-087477b85369 service nova] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:48.891027 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 527/1036] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:49.805783 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19737d-c19c-464e-a2cc-fb9f5350e411 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:49.806301 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19737d-c19c-464e-a2cc-fb9f5350e411 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:49.806400 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19737d-c19c-464e-a2cc-fb9f5350e411 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:49.807735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 510/1037] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 11:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:49.812563 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e858e94-06c1-4d44-9457-8308d1e189b3 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:49.812996 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e858e94-06c1-4d44-9457-8308d1e189b3 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:49.813128 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e858e94-06c1-4d44-9457-8308d1e189b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:49.835321 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-8e858e94-06c1-4d44-9457-8308d1e189b3 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:49.836534 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-8e858e94-06c1-4d44-9457-8308d1e189b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:49.844469 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 528/1038] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 11:09:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:50.003203 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19737d-c19c-464e-a2cc-fb9f5350e411 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:50.017326 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19737d-c19c-464e-a2cc-fb9f5350e411 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:50.022260 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97b9f0-d65a-4acb-b0dd-cff90d2f486c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:50.022863 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97b9f0-d65a-4acb-b0dd-cff90d2f486c service nova] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:50.023170 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97b9f0-d65a-4acb-b0dd-cff90d2f486c service nova] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:50.023489 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97b9f0-d65a-4acb-b0dd-cff90d2f486c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:50.031689 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97b9f0-d65a-4acb-b0dd-cff90d2f486c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:50.033911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97b9f0-d65a-4acb-b0dd-cff90d2f486c service nova] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:50.043255 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 511/1039] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:50.905898 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c71575-dd55-4d1b-a01d-d1c02e7efddc None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:50.906468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c71575-dd55-4d1b-a01d-d1c02e7efddc None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:50.906468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c71575-dd55-4d1b-a01d-d1c02e7efddc None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:50.907866 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 529/1040] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 11:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:50.913172 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab252da6-edc5-4782-baa3-4ff423808b10 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:50.913579 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab252da6-edc5-4782-baa3-4ff423808b10 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:50.913731 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab252da6-edc5-4782-baa3-4ff423808b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:50.932986 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-ab252da6-edc5-4782-baa3-4ff423808b10 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:50.934188 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-ab252da6-edc5-4782-baa3-4ff423808b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:50.942177 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 512/1041] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 11:09:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:51.100545 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c71575-dd55-4d1b-a01d-d1c02e7efddc None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:51.114642 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c71575-dd55-4d1b-a01d-d1c02e7efddc None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:51.119509 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c2c86-c685-46b3-825c-fb0a3cd8b44b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:51.120112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c2c86-c685-46b3-825c-fb0a3cd8b44b service nova] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:51.120394 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c2c86-c685-46b3-825c-fb0a3cd8b44b service nova] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:51.120668 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c2c86-c685-46b3-825c-fb0a3cd8b44b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:51.131437 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c2c86-c685-46b3-825c-fb0a3cd8b44b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:51.133123 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c2c86-c685-46b3-825c-fb0a3cd8b44b service nova] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:51.145818 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 530/1042] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:52.023058 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5317e1-711c-479b-9b58-893380244c6f None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:52.023665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5317e1-711c-479b-9b58-893380244c6f None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:52.023665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5317e1-711c-479b-9b58-893380244c6f None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:52.025010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 513/1043] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 11:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:52.029901 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c37f75-ba2a-4800-a891-1c2ae989a48b None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:52.030279 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c37f75-ba2a-4800-a891-1c2ae989a48b None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:52.030470 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c37f75-ba2a-4800-a891-1c2ae989a48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:52.049483 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-09c37f75-ba2a-4800-a891-1c2ae989a48b None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:52.050682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-09c37f75-ba2a-4800-a891-1c2ae989a48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:52.058460 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 531/1044] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 11:09:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:52.213951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5317e1-711c-479b-9b58-893380244c6f None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:52.227407 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5317e1-711c-479b-9b58-893380244c6f None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:52.232390 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a49657-3cd5-412c-9182-695a65215248 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:52.232996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a49657-3cd5-412c-9182-695a65215248 service nova] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:52.233282 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a49657-3cd5-412c-9182-695a65215248 service nova] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:52.233561 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a49657-3cd5-412c-9182-695a65215248 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:52.242117 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a49657-3cd5-412c-9182-695a65215248 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:52.243797 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a49657-3cd5-412c-9182-695a65215248 service nova] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:52.253742 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 514/1045] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:53.063091 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edea07-6b1f-4e7e-8c84-d52418d7d9d5 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:53.063740 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edea07-6b1f-4e7e-8c84-d52418d7d9d5 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:53.063740 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edea07-6b1f-4e7e-8c84-d52418d7d9d5 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:53.065142 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 532/1046] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 11:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:53.070158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570d1a7-8919-464a-a4a0-f211cab42661 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:53.070603 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570d1a7-8919-464a-a4a0-f211cab42661 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:53.070711 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570d1a7-8919-464a-a4a0-f211cab42661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:53.090071 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-b570d1a7-8919-464a-a4a0-f211cab42661 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:53.091304 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-b570d1a7-8919-464a-a4a0-f211cab42661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:53.099847 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 515/1047] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 11:09:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:53.256789 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edea07-6b1f-4e7e-8c84-d52418d7d9d5 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:53.270883 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edea07-6b1f-4e7e-8c84-d52418d7d9d5 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:53.275823 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77121f83-d745-4a22-96dd-7b2efa8d6c71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:53.276435 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77121f83-d745-4a22-96dd-7b2efa8d6c71 service nova] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:53.276723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77121f83-d745-4a22-96dd-7b2efa8d6c71 service nova] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:53.277009 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77121f83-d745-4a22-96dd-7b2efa8d6c71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:53.285836 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77121f83-d745-4a22-96dd-7b2efa8d6c71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:53.287512 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77121f83-d745-4a22-96dd-7b2efa8d6c71 service nova] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:53.297039 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 533/1048] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:54.108744 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7aa52-844e-4df9-a03d-344c8cbfab60 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:54.109313 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7aa52-844e-4df9-a03d-344c8cbfab60 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:54.109313 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7aa52-844e-4df9-a03d-344c8cbfab60 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:54.111307 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 516/1049] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 11:09:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:54.116222 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9f80e-6207-416e-a662-d2311ff9303d None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:54.116657 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9f80e-6207-416e-a662-d2311ff9303d None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:54.116766 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9f80e-6207-416e-a662-d2311ff9303d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:54.135606 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-5fe9f80e-6207-416e-a662-d2311ff9303d None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:54.136784 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-5fe9f80e-6207-416e-a662-d2311ff9303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:54.144811 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 534/1050] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 11:09:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:54.305644 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7aa52-844e-4df9-a03d-344c8cbfab60 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:54.318990 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7aa52-844e-4df9-a03d-344c8cbfab60 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:54.324010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b280cfe-3c8f-4c23-b8b8-7cbf57d40e64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:54.324614 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b280cfe-3c8f-4c23-b8b8-7cbf57d40e64 service nova] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:54.324899 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b280cfe-3c8f-4c23-b8b8-7cbf57d40e64 service nova] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:54.325179 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b280cfe-3c8f-4c23-b8b8-7cbf57d40e64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:54.333411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b280cfe-3c8f-4c23-b8b8-7cbf57d40e64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:54.335029 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b280cfe-3c8f-4c23-b8b8-7cbf57d40e64 service nova] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:54.344410 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 517/1051] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:55.150053 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfbcfb-879a-4895-a600-adbe6356afe9 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:55.150525 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfbcfb-879a-4895-a600-adbe6356afe9 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:55.150622 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfbcfb-879a-4895-a600-adbe6356afe9 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:55.152005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 535/1052] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 11:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:55.156797 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd75789-5199-4e34-8852-52b4b4673051 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:55.157226 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd75789-5199-4e34-8852-52b4b4673051 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:55.157365 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd75789-5199-4e34-8852-52b4b4673051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:55.176836 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-3cd75789-5199-4e34-8852-52b4b4673051 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:55.178037 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-3cd75789-5199-4e34-8852-52b4b4673051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:55.185776 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 518/1053] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 11:09:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:09:55.346656 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfbcfb-879a-4895-a600-adbe6356afe9 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:55.360111 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfbcfb-879a-4895-a600-adbe6356afe9 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:55.365774 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1cbbd-91cd-4673-9f08-fdb0950b0ccd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:55.366394 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1cbbd-91cd-4673-9f08-fdb0950b0ccd service nova] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:55.366683 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1cbbd-91cd-4673-9f08-fdb0950b0ccd service nova] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:55.366987 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1cbbd-91cd-4673-9f08-fdb0950b0ccd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:55.375662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1cbbd-91cd-4673-9f08-fdb0950b0ccd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:55.377758 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1cbbd-91cd-4673-9f08-fdb0950b0ccd service nova] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:55.387120 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 536/1054] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:56.189226 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551c2c2-2d1f-4184-be7f-e7b038f528b2 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:56.189762 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551c2c2-2d1f-4184-be7f-e7b038f528b2 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:56.189762 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551c2c2-2d1f-4184-be7f-e7b038f528b2 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:56.191113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 519/1055] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 11:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:56.196019 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155df62-547a-4d85-a3fb-f6bc3ed99764 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:56.196462 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155df62-547a-4d85-a3fb-f6bc3ed99764 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:56.196656 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155df62-547a-4d85-a3fb-f6bc3ed99764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:56.216760 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-8155df62-547a-4d85-a3fb-f6bc3ed99764 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:56.217966 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-8155df62-547a-4d85-a3fb-f6bc3ed99764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:56.226449 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 537/1056] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 11:09:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:56.380919 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551c2c2-2d1f-4184-be7f-e7b038f528b2 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:56.395113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551c2c2-2d1f-4184-be7f-e7b038f528b2 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:56.400112 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18db10-f67e-430e-a1cf-d5dfc4cdb1de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:56.400749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18db10-f67e-430e-a1cf-d5dfc4cdb1de service nova] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:56.401013 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18db10-f67e-430e-a1cf-d5dfc4cdb1de service nova] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:56.401291 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18db10-f67e-430e-a1cf-d5dfc4cdb1de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:56.409875 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18db10-f67e-430e-a1cf-d5dfc4cdb1de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:56.411532 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18db10-f67e-430e-a1cf-d5dfc4cdb1de service nova] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:56.421070 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 520/1057] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:09:58.533977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbcbfa-8ddf-48cd-82df-f287c3eaaec7 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:58.534507 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbcbfa-8ddf-48cd-82df-f287c3eaaec7 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:58.534641 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbcbfa-8ddf-48cd-82df-f287c3eaaec7 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:58.535973 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 538/1058] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 11:09:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:09:58.541247 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4f03f-e2c1-4972-8e5d-9affc66338ee None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:58.541668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4f03f-e2c1-4972-8e5d-9affc66338ee None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:58.541805 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4f03f-e2c1-4972-8e5d-9affc66338ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:58.561828 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-5ad4f03f-e2c1-4972-8e5d-9affc66338ee None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:09:58.563017 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-5ad4f03f-e2c1-4972-8e5d-9affc66338ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:09:58.570770 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 521/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 11:09:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:09:58.610259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbcbfa-8ddf-48cd-82df-f287c3eaaec7 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:09:58.621807 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbcbfa-8ddf-48cd-82df-f287c3eaaec7 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:09:58.625382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613002c-3297-414a-95a5-87505595d02e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:09:58.626023 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613002c-3297-414a-95a5-87505595d02e service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:09:58.626311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613002c-3297-414a-95a5-87505595d02e service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:09:58.626590 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613002c-3297-414a-95a5-87505595d02e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:09:58.635573 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613002c-3297-414a-95a5-87505595d02e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:09:58.636959 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613002c-3297-414a-95a5-87505595d02e service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:09:58.646602 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 539/1060] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:09:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:10:01.102637 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477ee33-cc53-4a3d-89f0-5518d7f1465e None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:01.103232 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477ee33-cc53-4a3d-89f0-5518d7f1465e None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:01.103232 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477ee33-cc53-4a3d-89f0-5518d7f1465e None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:01.104565 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 522/1061] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 11:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:10:01.109801 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47abd4e-faf9-4946-b98b-eac84676476f None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:01.110276 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47abd4e-faf9-4946-b98b-eac84676476f None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:01.111020 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47abd4e-faf9-4946-b98b-eac84676476f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:01.129732 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-d47abd4e-faf9-4946-b98b-eac84676476f None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:10:01.131061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-d47abd4e-faf9-4946-b98b-eac84676476f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:10:01.138727 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 540/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 11:10:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:10:01.179030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477ee33-cc53-4a3d-89f0-5518d7f1465e None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:10:01.189891 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477ee33-cc53-4a3d-89f0-5518d7f1465e None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:10:01.193442 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa3d20-410a-4ce6-936e-d7a3aed84600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:10:01.194044 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa3d20-410a-4ce6-936e-d7a3aed84600 service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:01.194345 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa3d20-410a-4ce6-936e-d7a3aed84600 service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:01.194603 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa3d20-410a-4ce6-936e-d7a3aed84600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:01.204687 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa3d20-410a-4ce6-936e-d7a3aed84600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:10:01.206118 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa3d20-410a-4ce6-936e-d7a3aed84600 service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:10:01.216061 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 523/1063] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:10:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:10:03.733497 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0215265-d8e5-4721-a0da-190c9c11ee32 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:03.734035 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0215265-d8e5-4721-a0da-190c9c11ee32 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:03.734035 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0215265-d8e5-4721-a0da-190c9c11ee32 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:03.735984 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 541/1064] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 11:10:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:10:03.741268 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d9abd-ab1a-47f4-b9df-cd1e4291b410 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:03.741692 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d9abd-ab1a-47f4-b9df-cd1e4291b410 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:03.741830 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d9abd-ab1a-47f4-b9df-cd1e4291b410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:03.761280 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-9d1d9abd-ab1a-47f4-b9df-cd1e4291b410 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:10:03.762488 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-9d1d9abd-ab1a-47f4-b9df-cd1e4291b410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:10:03.770652 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 524/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 11:10:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:10:03.810826 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0215265-d8e5-4721-a0da-190c9c11ee32 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:10:03.822533 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0215265-d8e5-4721-a0da-190c9c11ee32 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:10:03.826044 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276acfbb-7873-428b-a099-92b6e9f75474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:10:03.826640 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276acfbb-7873-428b-a099-92b6e9f75474 service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:03.826923 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276acfbb-7873-428b-a099-92b6e9f75474 service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:03.827205 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276acfbb-7873-428b-a099-92b6e9f75474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:03.836862 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276acfbb-7873-428b-a099-92b6e9f75474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:10:03.838300 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276acfbb-7873-428b-a099-92b6e9f75474 service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:10:03.848474 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 542/1066] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:10:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:10:06.208495 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30916c93-276a-41e0-9d3c-f67d5d7ab328 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:06.209060 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30916c93-276a-41e0-9d3c-f67d5d7ab328 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:06.209060 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30916c93-276a-41e0-9d3c-f67d5d7ab328 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:06.210381 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 525/1067] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 11:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:10:06.216241 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa436454-3428-4a36-8dc6-6a6785d785a2 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:06.216702 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa436454-3428-4a36-8dc6-6a6785d785a2 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:06.216799 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa436454-3428-4a36-8dc6-6a6785d785a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:06.236296 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-aa436454-3428-4a36-8dc6-6a6785d785a2 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:10:06.237477 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-aa436454-3428-4a36-8dc6-6a6785d785a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:10:06.245065 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 543/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 11:10:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:10:06.284380 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30916c93-276a-41e0-9d3c-f67d5d7ab328 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:10:06.294877 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30916c93-276a-41e0-9d3c-f67d5d7ab328 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:10:06.298996 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eeafd5-8a15-47dc-914d-3a8900725a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:10:06.299644 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eeafd5-8a15-47dc-914d-3a8900725a6c service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:06.299927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eeafd5-8a15-47dc-914d-3a8900725a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:06.300203 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eeafd5-8a15-47dc-914d-3a8900725a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:06.310274 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eeafd5-8a15-47dc-914d-3a8900725a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:10:06.311772 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eeafd5-8a15-47dc-914d-3a8900725a6c service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:10:06.321271 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 526/1069] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:10:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:10:08.669219 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72034e0-2df3-4230-ab8f-7593de70d3c8 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:08.669756 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72034e0-2df3-4230-ab8f-7593de70d3c8 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:08.669756 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72034e0-2df3-4230-ab8f-7593de70d3c8 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:08.671050 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 544/1070] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 11:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:10:08.676948 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f49fc2-8f56-4c56-9322-039b1b16f5bd None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:08.677381 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f49fc2-8f56-4c56-9322-039b1b16f5bd None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:08.677528 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f49fc2-8f56-4c56-9322-039b1b16f5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:08.696786 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-d7f49fc2-8f56-4c56-9322-039b1b16f5bd None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:10:08.697984 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-d7f49fc2-8f56-4c56-9322-039b1b16f5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:10:08.705885 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 527/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 11:10:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:10:08.744658 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72034e0-2df3-4230-ab8f-7593de70d3c8 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:10:08.756015 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72034e0-2df3-4230-ab8f-7593de70d3c8 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:10:08.759541 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6fc66-3df6-477e-9801-204fff6c6f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:10:08.760145 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6fc66-3df6-477e-9801-204fff6c6f6f service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:08.760426 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6fc66-3df6-477e-9801-204fff6c6f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:08.760703 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6fc66-3df6-477e-9801-204fff6c6f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:08.770020 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6fc66-3df6-477e-9801-204fff6c6f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:10:08.771474 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6fc66-3df6-477e-9801-204fff6c6f6f service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:10:08.780754 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 545/1072] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:10:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:10:11.142679 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c70e1-3a5a-4fde-9e7d-4af366facc06 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:11.143080 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c70e1-3a5a-4fde-9e7d-4af366facc06 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:11.143246 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c70e1-3a5a-4fde-9e7d-4af366facc06 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:11.144633 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 528/1073] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 11:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:10:11.150036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b13bc-470b-45f0-b262-0ad4216ed1f7 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:11.150503 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b13bc-470b-45f0-b262-0ad4216ed1f7 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:11.150619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b13bc-470b-45f0-b262-0ad4216ed1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:11.170969 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-743b13bc-470b-45f0-b262-0ad4216ed1f7 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:10:11.172225 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-743b13bc-470b-45f0-b262-0ad4216ed1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:10:11.180737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 546/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 11:10:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:10:11.226486 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c70e1-3a5a-4fde-9e7d-4af366facc06 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:10:11.237616 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c70e1-3a5a-4fde-9e7d-4af366facc06 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:10:11.241063 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce837850-2dfe-4987-b29c-e7fec24d54bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:10:11.241664 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce837850-2dfe-4987-b29c-e7fec24d54bf service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:11.241940 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce837850-2dfe-4987-b29c-e7fec24d54bf service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:11.242211 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce837850-2dfe-4987-b29c-e7fec24d54bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:11.251683 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce837850-2dfe-4987-b29c-e7fec24d54bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:10:11.253115 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce837850-2dfe-4987-b29c-e7fec24d54bf service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:10:11.262298 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 529/1075] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:10:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:10:13.545970 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21d5d4-4c5a-41e0-93b1-69f14c3879ad None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:13.546517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21d5d4-4c5a-41e0-93b1-69f14c3879ad None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:13.546517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21d5d4-4c5a-41e0-93b1-69f14c3879ad None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:13.548279 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 547/1076] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 11:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:10:13.553330 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd8f95-5186-4890-b139-e2c579d5452c None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:13.553748 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd8f95-5186-4890-b139-e2c579d5452c None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:13.553884 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd8f95-5186-4890-b139-e2c579d5452c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:13.561263 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=70 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:10:13.574410 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-f2fd8f95-5186-4890-b139-e2c579d5452c None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:10:13.575668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-f2fd8f95-5186-4890-b139-e2c579d5452c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:10:13.584110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 530/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 11:10:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:10:13.621418 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21d5d4-4c5a-41e0-93b1-69f14c3879ad None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:10:13.627486 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=73 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:10:13.632979 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21d5d4-4c5a-41e0-93b1-69f14c3879ad None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:10:13.637027 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7eafc-b04e-4268-8fba-75502e18df69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:10:13.637637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7eafc-b04e-4268-8fba-75502e18df69 service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:13.637917 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7eafc-b04e-4268-8fba-75502e18df69 service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:13.638193 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7eafc-b04e-4268-8fba-75502e18df69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:13.648452 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7eafc-b04e-4268-8fba-75502e18df69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:10:13.649913 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7eafc-b04e-4268-8fba-75502e18df69 service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:10:13.659128 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 548/1078] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:10:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:10:15.990136 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9ec0-ed83-4d48-8318-37e3f2626d19 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:15.990825 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9ec0-ed83-4d48-8318-37e3f2626d19 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:15.990825 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9ec0-ed83-4d48-8318-37e3f2626d19 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:15.992204 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 531/1079] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 11:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:10:15.997819 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b351e1c-d5e4-4083-b0cf-95e4bb445109 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:15.998305 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b351e1c-d5e4-4083-b0cf-95e4bb445109 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:15.998440 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b351e1c-d5e4-4083-b0cf-95e4bb445109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:16.017843 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-9b351e1c-d5e4-4083-b0cf-95e4bb445109 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:10:16.019049 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-9b351e1c-d5e4-4083-b0cf-95e4bb445109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:10:16.026936 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 549/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 11:10:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:10:16.068576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede9ec0-ed83-4d48-8318-37e3f2626d19 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:10:16.081049 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede9ec0-ed83-4d48-8318-37e3f2626d19 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:10:16.084506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d28891-1354-465c-9f51-fe8eab8eeed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:10:16.085110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d28891-1354-465c-9f51-fe8eab8eeed2 service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:16.085388 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d28891-1354-465c-9f51-fe8eab8eeed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:16.085663 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d28891-1354-465c-9f51-fe8eab8eeed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:16.095476 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d28891-1354-465c-9f51-fe8eab8eeed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:10:16.096921 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d28891-1354-465c-9f51-fe8eab8eeed2 service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:10:16.106667 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 532/1081] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:10:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:10:18.336343 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37232211-f547-4940-bf6b-2abcd73ce5ec None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:18.336907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37232211-f547-4940-bf6b-2abcd73ce5ec None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:18.337008 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37232211-f547-4940-bf6b-2abcd73ce5ec None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:18.338285 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 550/1082] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 11:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:10:18.343430 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2ef46-d182-4273-8415-9046ca8859ac None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:18.343874 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2ef46-d182-4273-8415-9046ca8859ac None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:18.343984 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2ef46-d182-4273-8415-9046ca8859ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:18.362718 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-24c2ef46-d182-4273-8415-9046ca8859ac None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:10:18.363949 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-24c2ef46-d182-4273-8415-9046ca8859ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:10:18.371938 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 533/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 11:10:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:10:18.411107 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37232211-f547-4940-bf6b-2abcd73ce5ec None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:10:18.422132 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37232211-f547-4940-bf6b-2abcd73ce5ec None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:10:18.426260 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30e722-5b79-40b4-8b68-d6c03c45cefb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:10:18.426864 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30e722-5b79-40b4-8b68-d6c03c45cefb service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:18.427145 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30e722-5b79-40b4-8b68-d6c03c45cefb service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:18.427459 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30e722-5b79-40b4-8b68-d6c03c45cefb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:18.436573 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30e722-5b79-40b4-8b68-d6c03c45cefb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:10:18.438686 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30e722-5b79-40b4-8b68-d6c03c45cefb service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:10:18.448253 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 551/1084] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:10:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:10:20.688773 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036de534-e9f2-428a-bce9-b9cb339a3534 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:20.689303 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036de534-e9f2-428a-bce9-b9cb339a3534 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:20.689303 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036de534-e9f2-428a-bce9-b9cb339a3534 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:20.690585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 534/1085] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 11:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:10:20.696047 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fde95-8813-49bd-9d99-58b201decbc7 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:20.696479 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fde95-8813-49bd-9d99-58b201decbc7 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:20.696596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fde95-8813-49bd-9d99-58b201decbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:20.715241 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-a64fde95-8813-49bd-9d99-58b201decbc7 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:10:20.716455 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-a64fde95-8813-49bd-9d99-58b201decbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:10:20.724199 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 552/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 11:10:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:10:20.762731 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036de534-e9f2-428a-bce9-b9cb339a3534 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:10:20.773675 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036de534-e9f2-428a-bce9-b9cb339a3534 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:10:20.777188 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205413a-fd25-4225-8a30-ccb29f8da86a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:10:20.777790 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205413a-fd25-4225-8a30-ccb29f8da86a service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:20.778075 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205413a-fd25-4225-8a30-ccb29f8da86a service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:20.778354 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205413a-fd25-4225-8a30-ccb29f8da86a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:20.787208 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205413a-fd25-4225-8a30-ccb29f8da86a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:10:20.788686 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205413a-fd25-4225-8a30-ccb29f8da86a service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:10:20.798621 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 535/1087] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:10:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:10:30.715392 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=17 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:10:30.794014 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=17 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:10:44.424322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41505dd6-a3b0-4759-a5ec-f48af8f4865d None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:44.424884 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41505dd6-a3b0-4759-a5ec-f48af8f4865d None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:44.424884 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41505dd6-a3b0-4759-a5ec-f48af8f4865d None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:44.426443 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 553/1088] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:10:44.431915 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c4264-c125-4690-b6d0-69c83f0e0bee None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:44.432365 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c4264-c125-4690-b6d0-69c83f0e0bee None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:44.432470 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c4264-c125-4690-b6d0-69c83f0e0bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:44.453247 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-0f5c4264-c125-4690-b6d0-69c83f0e0bee None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:10:44.455098 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-0f5c4264-c125-4690-b6d0-69c83f0e0bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:10:44.463430 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 536/1089] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:10:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:10:44.515222 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f783b-1b1b-46fa-a6c8-df682c6d1609 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:44.515539 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f783b-1b1b-46fa-a6c8-df682c6d1609 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:44.515815 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f783b-1b1b-46fa-a6c8-df682c6d1609 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:44.517696 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 554/1090] 10.222.0.71 () {54 vars in 966 bytes} [Thu Jul 28 11:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:10:44.523144 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f86041-e305-4ec7-94d1-1e6a82fd5855 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:44.523476 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f86041-e305-4ec7-94d1-1e6a82fd5855 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:44.523762 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f86041-e305-4ec7-94d1-1e6a82fd5855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:44.543352 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-d6f86041-e305-4ec7-94d1-1e6a82fd5855 None None] MFA Rules not processed for user `51f33b105ddb4c81a9ead57fd2d888ac`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:10:44.544471 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-d6f86041-e305-4ec7-94d1-1e6a82fd5855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:10:44.551000 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 537/1091] 10.222.0.71 () {58 vars in 1063 bytes} [Thu Jul 28 11:10:44 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:10:44.558395 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f783b-1b1b-46fa-a6c8-df682c6d1609 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:10:44.569607 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f783b-1b1b-46fa-a6c8-df682c6d1609 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:10:44.573107 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cd719-f03c-4aea-87f9-798c9610a655 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f33b105ddb4c81a9ead57fd2d888ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:10:44.573722 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cd719-f03c-4aea-87f9-798c9610a655 service glance] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:44.574003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cd719-f03c-4aea-87f9-798c9610a655 service glance] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:44.574283 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cd719-f03c-4aea-87f9-798c9610a655 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:44.584208 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cd719-f03c-4aea-87f9-798c9610a655 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:10:44.585650 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cd719-f03c-4aea-87f9-798c9610a655 service glance] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:10:44.595565 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 555/1092] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:10:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 11:10:46.972650 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780af3b2-7c90-49fc-bc08-5ba174c17c8b None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:46.973251 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780af3b2-7c90-49fc-bc08-5ba174c17c8b None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:46.973251 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780af3b2-7c90-49fc-bc08-5ba174c17c8b None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:46.974576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 538/1093] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:10:46.980180 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed32eb-c210-46cd-8723-540b01bad656 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:46.980615 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed32eb-c210-46cd-8723-540b01bad656 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:46.980735 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed32eb-c210-46cd-8723-540b01bad656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:46.999326 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-c8ed32eb-c210-46cd-8723-540b01bad656 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:10:47.000522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-c8ed32eb-c210-46cd-8723-540b01bad656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:10:47.008302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 556/1094] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:10:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:10:47.033312 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780af3b2-7c90-49fc-bc08-5ba174c17c8b None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:10:47.045592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780af3b2-7c90-49fc-bc08-5ba174c17c8b None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:10:47.050083 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74941524-b8ad-47fb-930c-a6a2042910b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:10:47.050684 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941524-b8ad-47fb-930c-a6a2042910b6 admin admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:47.050963 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941524-b8ad-47fb-930c-a6a2042910b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:47.051236 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941524-b8ad-47fb-930c-a6a2042910b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:47.051949 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74941524-b8ad-47fb-930c-a6a2042910b6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:10:47.053732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: WARNING py.warnings [None req-74941524-b8ad-47fb-930c-a6a2042910b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:10:47.053732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: warnings.warn(msg) Jul 28 11:10:47.053732 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: Jul 28 11:10:47.054836 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74941524-b8ad-47fb-930c-a6a2042910b6 admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:10:47.072521 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 539/1095] 10.222.0.71 () {56 vars in 1108 bytes} [Thu Jul 28 11:10:47 2022] GET /identity/v3/projects => generated 1606 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 11:10:49.304468 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97190c52-d8a8-4e97-a850-86417736c464 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:49.305034 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97190c52-d8a8-4e97-a850-86417736c464 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:49.305034 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97190c52-d8a8-4e97-a850-86417736c464 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:49.306504 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 557/1096] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:10:49.312114 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7c936-078f-4954-b569-bf83d75753c7 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:49.312648 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7c936-078f-4954-b569-bf83d75753c7 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:49.312786 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7c936-078f-4954-b569-bf83d75753c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:49.336405 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-e5e7c936-078f-4954-b569-bf83d75753c7 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:10:49.338346 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-e5e7c936-078f-4954-b569-bf83d75753c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:10:49.347078 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 540/1097] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:10:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:10:49.398129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97190c52-d8a8-4e97-a850-86417736c464 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:10:49.417940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97190c52-d8a8-4e97-a850-86417736c464 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:10:49.426100 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd74e9-f4dc-4338-ba53-ec23a77514e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:10:49.426885 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd74e9-f4dc-4338-ba53-ec23a77514e3 service nova] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:49.427162 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd74e9-f4dc-4338-ba53-ec23a77514e3 service nova] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:49.427608 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd74e9-f4dc-4338-ba53-ec23a77514e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:49.439254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd74e9-f4dc-4338-ba53-ec23a77514e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:10:49.440885 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd74e9-f4dc-4338-ba53-ec23a77514e3 service nova] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:10:49.450662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 558/1098] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:10:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:10:51.905084 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530361f8-5fb7-45f5-ae4e-cffbc217f3dd None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:51.905668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530361f8-5fb7-45f5-ae4e-cffbc217f3dd None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:51.905668 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530361f8-5fb7-45f5-ae4e-cffbc217f3dd None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:51.907037 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 541/1099] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:10:51.912548 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ae34e-c379-4253-9992-1663a73dc5a6 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:51.912989 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ae34e-c379-4253-9992-1663a73dc5a6 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:51.913130 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ae34e-c379-4253-9992-1663a73dc5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:51.931833 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-209ae34e-c379-4253-9992-1663a73dc5a6 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:10:51.933026 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-209ae34e-c379-4253-9992-1663a73dc5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:10:51.941554 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 559/1100] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:10:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:10:51.979532 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530361f8-5fb7-45f5-ae4e-cffbc217f3dd None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:10:51.990420 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530361f8-5fb7-45f5-ae4e-cffbc217f3dd None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:10:51.993864 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76012ddd-af7a-45fb-aa65-3aa62e42e735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:10:51.994469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76012ddd-af7a-45fb-aa65-3aa62e42e735 service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:51.994746 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76012ddd-af7a-45fb-aa65-3aa62e42e735 service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:51.995018 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76012ddd-af7a-45fb-aa65-3aa62e42e735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:52.004477 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76012ddd-af7a-45fb-aa65-3aa62e42e735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:10:52.006020 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76012ddd-af7a-45fb-aa65-3aa62e42e735 service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:10:52.015792 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 542/1101] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:10:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:10:54.558963 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c0cb4-9791-498d-95dc-09238ad1d697 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:54.559545 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c0cb4-9791-498d-95dc-09238ad1d697 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:54.559545 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c0cb4-9791-498d-95dc-09238ad1d697 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:54.560897 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 560/1102] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:10:54.566436 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253884fd-70d3-4158-8f8a-c1d17a8e6d2e None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:54.566939 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253884fd-70d3-4158-8f8a-c1d17a8e6d2e None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:54.567043 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253884fd-70d3-4158-8f8a-c1d17a8e6d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:54.586934 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-253884fd-70d3-4158-8f8a-c1d17a8e6d2e None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:10:54.588155 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-253884fd-70d3-4158-8f8a-c1d17a8e6d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:10:54.597280 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 543/1103] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:10:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:10:54.641907 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c0cb4-9791-498d-95dc-09238ad1d697 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:10:54.656869 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c0cb4-9791-498d-95dc-09238ad1d697 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:10:54.663941 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33676a-a0f7-4aa4-940d-a4ce52e51b1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:10:54.664672 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33676a-a0f7-4aa4-940d-a4ce52e51b1d service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:54.665164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33676a-a0f7-4aa4-940d-a4ce52e51b1d service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:54.665663 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33676a-a0f7-4aa4-940d-a4ce52e51b1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:54.682692 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33676a-a0f7-4aa4-940d-a4ce52e51b1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:10:54.684837 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33676a-a0f7-4aa4-940d-a4ce52e51b1d service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:10:54.696775 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 561/1104] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:10:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:10:57.109110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556cd6-a893-4d2d-a6a8-4bbea8086c41 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:57.110245 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556cd6-a893-4d2d-a6a8-4bbea8086c41 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:57.110445 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556cd6-a893-4d2d-a6a8-4bbea8086c41 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:57.111804 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 544/1105] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:10:57.117090 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe59ca-36db-4563-afb4-3454a25209fc None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:57.117546 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe59ca-36db-4563-afb4-3454a25209fc None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:57.117651 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe59ca-36db-4563-afb4-3454a25209fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:57.136525 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-86fe59ca-36db-4563-afb4-3454a25209fc None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:10:57.137717 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-86fe59ca-36db-4563-afb4-3454a25209fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:10:57.145689 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 562/1106] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:10:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:10:57.187288 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab556cd6-a893-4d2d-a6a8-4bbea8086c41 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:10:57.197894 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab556cd6-a893-4d2d-a6a8-4bbea8086c41 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:10:57.201376 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc6610-3afd-4514-bce3-10d7d1ed82b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:10:57.201982 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc6610-3afd-4514-bce3-10d7d1ed82b8 service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:57.202269 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc6610-3afd-4514-bce3-10d7d1ed82b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:57.202555 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc6610-3afd-4514-bce3-10d7d1ed82b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:57.211383 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc6610-3afd-4514-bce3-10d7d1ed82b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:10:57.212834 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc6610-3afd-4514-bce3-10d7d1ed82b8 service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:10:57.222772 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 545/1107] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:10:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:10:59.674312 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e1205-4e0c-4e8f-bd15-b48ac4a218e2 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:59.674873 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e1205-4e0c-4e8f-bd15-b48ac4a218e2 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:59.674873 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e1205-4e0c-4e8f-bd15-b48ac4a218e2 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:59.676278 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 563/1108] 10.222.0.71 () {54 vars in 926 bytes} [Thu Jul 28 11:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:10:59.681314 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e0fe4-e2a2-4482-81ab-061af2574dea None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:59.681694 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e0fe4-e2a2-4482-81ab-061af2574dea None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:59.681871 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e0fe4-e2a2-4482-81ab-061af2574dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:59.700781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-f39e0fe4-e2a2-4482-81ab-061af2574dea None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:10:59.701956 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-f39e0fe4-e2a2-4482-81ab-061af2574dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:10:59.710765 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 546/1109] 10.222.0.71 () {58 vars in 1023 bytes} [Thu Jul 28 11:10:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:10:59.750497 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e1205-4e0c-4e8f-bd15-b48ac4a218e2 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:10:59.761143 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e1205-4e0c-4e8f-bd15-b48ac4a218e2 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:10:59.764695 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003f27e-fa59-4215-aefb-3de2e6980ef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:10:59.766042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003f27e-fa59-4215-aefb-3de2e6980ef5 service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:10:59.766324 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003f27e-fa59-4215-aefb-3de2e6980ef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:10:59.766606 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003f27e-fa59-4215-aefb-3de2e6980ef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:10:59.775570 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003f27e-fa59-4215-aefb-3de2e6980ef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:10:59.776990 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003f27e-fa59-4215-aefb-3de2e6980ef5 service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:10:59.786824 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 564/1110] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:10:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:11:09.696065 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=33 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:11:09.782748 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=33 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:12:30.116063 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d083a-f37e-4e94-9c89-7321d5260b34 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:12:30.116741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d083a-f37e-4e94-9c89-7321d5260b34 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:12:30.116741 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d083a-f37e-4e94-9c89-7321d5260b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:12:30.137995 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-196d083a-f37e-4e94-9c89-7321d5260b34 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:12:30.139315 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-196d083a-f37e-4e94-9c89-7321d5260b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:12:30.147977 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 547/1111] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:12:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:12:30.156960 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7010155-0edf-4261-a275-e28cfd123302 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:12:30.157601 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7010155-0edf-4261-a275-e28cfd123302 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:12:30.157601 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7010155-0edf-4261-a275-e28cfd123302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:12:30.178420 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-b7010155-0edf-4261-a275-e28cfd123302 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:12:30.179776 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-b7010155-0edf-4261-a275-e28cfd123302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:12:30.188617 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 565/1112] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:12:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:12:30.193765 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d083a-f37e-4e94-9c89-7321d5260b34 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:12:30.205032 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d083a-f37e-4e94-9c89-7321d5260b34 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:12:30.210044 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760d72f-3191-4a69-a8a8-b2fb8f07840d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:12:30.210682 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760d72f-3191-4a69-a8a8-b2fb8f07840d admin admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:12:30.210964 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760d72f-3191-4a69-a8a8-b2fb8f07840d admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:12:30.211237 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760d72f-3191-4a69-a8a8-b2fb8f07840d admin admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:12:30.212028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760d72f-3191-4a69-a8a8-b2fb8f07840d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:12:30.212335 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760d72f-3191-4a69-a8a8-b2fb8f07840d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:12:30.213533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: WARNING py.warnings [None req-5760d72f-3191-4a69-a8a8-b2fb8f07840d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:12:30.213533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: warnings.warn(msg) Jul 28 11:12:30.213533 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: Jul 28 11:12:30.214464 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760d72f-3191-4a69-a8a8-b2fb8f07840d admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:12:30.228191 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 548/1113] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Jul 28 11:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 11:12:30.237414 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7010155-0edf-4261-a275-e28cfd123302 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:12:30.250436 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7010155-0edf-4261-a275-e28cfd123302 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:12:30.258333 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2304476-8daf-4ebb-8575-ea381cf3a461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:12:30.259423 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2304476-8daf-4ebb-8575-ea381cf3a461 admin admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:12:30.259914 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2304476-8daf-4ebb-8575-ea381cf3a461 admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:12:30.260418 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2304476-8daf-4ebb-8575-ea381cf3a461 admin admin] PATH_INFO: `/v3/projects` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:12:30.261370 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2304476-8daf-4ebb-8575-ea381cf3a461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:12:30.264514 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: WARNING py.warnings [None req-c2304476-8daf-4ebb-8575-ea381cf3a461 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:12:30.264514 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: warnings.warn(msg) Jul 28 11:12:30.264514 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: Jul 28 11:12:30.267014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2304476-8daf-4ebb-8575-ea381cf3a461 admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:12:30.314128 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 566/1114] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Jul 28 11:12:30 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:12:30.318881 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760d72f-3191-4a69-a8a8-b2fb8f07840d admin admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:12:30.336288 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760d72f-3191-4a69-a8a8-b2fb8f07840d admin admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:12:30.425791 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a1f06-78af-4904-ab23-b6401b49f66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:12:30.426503 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a1f06-78af-4904-ab23-b6401b49f66f admin admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:12:30.426833 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a1f06-78af-4904-ab23-b6401b49f66f admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:12:30.427155 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a1f06-78af-4904-ab23-b6401b49f66f admin admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:12:30.427945 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a1f06-78af-4904-ab23-b6401b49f66f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:12:30.429102 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: WARNING py.warnings [None req-df8a1f06-78af-4904-ab23-b6401b49f66f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:12:30.429102 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: warnings.warn(msg) Jul 28 11:12:30.429102 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: Jul 28 11:12:30.430508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a1f06-78af-4904-ab23-b6401b49f66f admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:12:30.454521 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 549/1115] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Jul 28 11:12:30 2022] POST /identity/v3/users => generated 290 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 11:12:30.459033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2304476-8daf-4ebb-8575-ea381cf3a461 admin admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:12:30.470662 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2304476-8daf-4ebb-8575-ea381cf3a461 admin admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:12:30.475847 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e91eed-5696-46cc-a73f-354b038a672a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:12:30.476493 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e91eed-5696-46cc-a73f-354b038a672a admin admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:12:30.476783 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e91eed-5696-46cc-a73f-354b038a672a admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:12:30.477065 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e91eed-5696-46cc-a73f-354b038a672a admin admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:12:30.477776 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e91eed-5696-46cc-a73f-354b038a672a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:12:30.478815 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: WARNING py.warnings [None req-f3e91eed-5696-46cc-a73f-354b038a672a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:12:30.478815 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: warnings.warn(msg) Jul 28 11:12:30.478815 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: Jul 28 11:12:30.479772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e91eed-5696-46cc-a73f-354b038a672a admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:12:30.494196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 567/1116] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Jul 28 11:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 11:12:30.500713 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a1f06-78af-4904-ab23-b6401b49f66f admin admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:12:30.515149 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a1f06-78af-4904-ab23-b6401b49f66f admin admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:12:30.520980 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83fa9d-89da-4db0-b203-f268a2669fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:12:30.521631 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83fa9d-89da-4db0-b203-f268a2669fdb admin admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:12:30.521919 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83fa9d-89da-4db0-b203-f268a2669fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:12:30.522201 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83fa9d-89da-4db0-b203-f268a2669fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:12:30.522916 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83fa9d-89da-4db0-b203-f268a2669fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:12:30.524006 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: WARNING py.warnings [None req-ef83fa9d-89da-4db0-b203-f268a2669fdb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:12:30.524006 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: warnings.warn(msg) Jul 28 11:12:30.524006 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: Jul 28 11:12:30.524913 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83fa9d-89da-4db0-b203-f268a2669fdb admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:12:30.541290 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 550/1117] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Jul 28 11:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 11:12:30.545995 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e91eed-5696-46cc-a73f-354b038a672a admin admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:12:30.556682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e91eed-5696-46cc-a73f-354b038a672a admin admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:12:30.561986 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2650a9-c88f-4cde-8cc0-244f5c0062cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:12:30.562696 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2650a9-c88f-4cde-8cc0-244f5c0062cc admin admin] REQUEST_METHOD: `PUT` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:12:30.562982 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2650a9-c88f-4cde-8cc0-244f5c0062cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:12:30.563292 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2650a9-c88f-4cde-8cc0-244f5c0062cc admin admin] PATH_INFO: `/v3/projects/d5d1bf72fe0341d488df9c4d8c125a21/users/9f0beee9be16498e887e39e8eb56b493/roles/05bb46007d644829b12b0d4ded0bd8d2` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:12:30.581211 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2650a9-c88f-4cde-8cc0-244f5c0062cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d1bf72fe0341d488df9c4d8c125a21, user_id=9f0beee9be16498e887e39e8eb56b493, role_id=05bb46007d644829b12b0d4ded0bd8d2)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:12:30.582280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: WARNING py.warnings [None req-eb2650a9-c88f-4cde-8cc0-244f5c0062cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:12:30.582280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: warnings.warn(msg) Jul 28 11:12:30.582280 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: Jul 28 11:12:30.584343 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2650a9-c88f-4cde-8cc0-244f5c0062cc admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:12:30.600841 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 568/1118] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Jul 28 11:12:30 2022] PUT /identity/v3/projects/d5d1bf72fe0341d488df9c4d8c125a21/users/9f0beee9be16498e887e39e8eb56b493/roles/05bb46007d644829b12b0d4ded0bd8d2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:12:30.613823 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f68f9-fed5-41f5-90d1-55d62dd19782 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:12:30.614159 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f68f9-fed5-41f5-90d1-55d62dd19782 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:12:30.614543 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f68f9-fed5-41f5-90d1-55d62dd19782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:12:30.646784 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-530f68f9-fed5-41f5-90d1-55d62dd19782 None None] MFA Rules not processed for user `9f0beee9be16498e887e39e8eb56b493`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:12:30.647957 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-530f68f9-fed5-41f5-90d1-55d62dd19782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:12:30.721046 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 551/1119] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:12:30 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:12:30.735532 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01961c25-25ab-4711-8ef6-73fcda6a504b None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:12:30.735826 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01961c25-25ab-4711-8ef6-73fcda6a504b None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:12:30.736112 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01961c25-25ab-4711-8ef6-73fcda6a504b None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:12:30.737522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 569/1120] 10.222.0.71 () {54 vars in 964 bytes} [Thu Jul 28 11:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:12:30.743712 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521268d-281b-4628-8db7-0575d49c208c None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:12:30.744194 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521268d-281b-4628-8db7-0575d49c208c None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:12:30.744676 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521268d-281b-4628-8db7-0575d49c208c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:12:30.778039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-0521268d-281b-4628-8db7-0575d49c208c None None] MFA Rules not processed for user `a13ee61417bf4b1696004d6d73cf2299`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:12:30.780821 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-0521268d-281b-4628-8db7-0575d49c208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:12:30.861717 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:12:30.876711 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 552/1121] 10.222.0.71 () {58 vars in 1061 bytes} [Thu Jul 28 11:12:30 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:12:30.887810 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01961c25-25ab-4711-8ef6-73fcda6a504b None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:12:30.900560 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01961c25-25ab-4711-8ef6-73fcda6a504b None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:12:30.904464 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f673261-f98e-49d0-b777-680e21d93632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a13ee61417bf4b1696004d6d73cf2299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:12:30.905203 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f673261-f98e-49d0-b777-680e21d93632 service cinder] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:12:30.905531 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f673261-f98e-49d0-b777-680e21d93632 service cinder] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:12:30.905785 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f673261-f98e-49d0-b777-680e21d93632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:12:30.915204 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f673261-f98e-49d0-b777-680e21d93632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:12:30.916710 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f673261-f98e-49d0-b777-680e21d93632 service cinder] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:12:30.927020 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 570/1122] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:12:30 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 11:12:30.978673 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb9aa4-707d-470e-9604-0d77056a759f None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:12:30.979161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb9aa4-707d-470e-9604-0d77056a759f None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:12:30.979161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb9aa4-707d-470e-9604-0d77056a759f None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:12:30.980492 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 553/1123] 10.222.0.71 () {52 vars in 830 bytes} [Thu Jul 28 11:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:12:30.987537 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f673261-f98e-49d0-b777-680e21d93632 service cinder] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:12:31.098574 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f673261-f98e-49d0-b777-680e21d93632 service cinder] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:12:31.103576 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299711db-244b-4dc6-b32f-763dad3e9b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:12:31.104259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299711db-244b-4dc6-b32f-763dad3e9b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:12:31.104548 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299711db-244b-4dc6-b32f-763dad3e9b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:12:31.104830 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299711db-244b-4dc6-b32f-763dad3e9b90 admin admin] PATH_INFO: `/v3/users/9f0beee9be16498e887e39e8eb56b493` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:12:31.106129 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299711db-244b-4dc6-b32f-763dad3e9b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f0beee9be16498e887e39e8eb56b493)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:12:31.107175 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: WARNING py.warnings [None req-299711db-244b-4dc6-b32f-763dad3e9b90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:12:31.107175 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: warnings.warn(msg) Jul 28 11:12:31.107175 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: Jul 28 11:12:31.108482 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299711db-244b-4dc6-b32f-763dad3e9b90 admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:12:31.189904 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-299711db-244b-4dc6-b32f-763dad3e9b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f0beee9be16498e887e39e8eb56b493'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:12:31.205096 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-299711db-244b-4dc6-b32f-763dad3e9b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f0beee9be16498e887e39e8eb56b493'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:12:31.238447 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-299711db-244b-4dc6-b32f-763dad3e9b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f0beee9be16498e887e39e8eb56b493'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:12:31.253806 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-299711db-244b-4dc6-b32f-763dad3e9b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f0beee9be16498e887e39e8eb56b493'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:12:31.254696 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-299711db-244b-4dc6-b32f-763dad3e9b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f0beee9be16498e887e39e8eb56b493'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:12:31.262435 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 571/1124] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Jul 28 11:12:30 2022] DELETE /identity/v3/users/9f0beee9be16498e887e39e8eb56b493 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:12:31.269519 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf46eef-7a2f-43bb-b88e-6ddfe425325e None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:12:31.270128 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf46eef-7a2f-43bb-b88e-6ddfe425325e None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:12:31.270128 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf46eef-7a2f-43bb-b88e-6ddfe425325e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:12:31.290802 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-bdf46eef-7a2f-43bb-b88e-6ddfe425325e None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:12:31.292090 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-bdf46eef-7a2f-43bb-b88e-6ddfe425325e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:12:31.362257 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 554/1125] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:12:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:12:31.377616 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299711db-244b-4dc6-b32f-763dad3e9b90 admin admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:12:31.380043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-299711db-244b-4dc6-b32f-763dad3e9b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:12:31.390055 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:12:31.486213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299711db-244b-4dc6-b32f-763dad3e9b90 admin admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:12:31.492485 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721418f1-2585-4a7b-a857-a23316f1d605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:12:31.493579 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721418f1-2585-4a7b-a857-a23316f1d605 service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:12:31.494084 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721418f1-2585-4a7b-a857-a23316f1d605 service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:12:31.494585 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721418f1-2585-4a7b-a857-a23316f1d605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:12:31.511519 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721418f1-2585-4a7b-a857-a23316f1d605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:12:31.514512 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721418f1-2585-4a7b-a857-a23316f1d605 service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:12:31.532957 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 572/1126] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:12:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:12:32.025216 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf46eef-7a2f-43bb-b88e-6ddfe425325e None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:12:32.026934 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-bdf46eef-7a2f-43bb-b88e-6ddfe425325e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:12:32.046673 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf46eef-7a2f-43bb-b88e-6ddfe425325e None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:12:32.055316 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a90269-9689-4211-acd3-f82f3c2336d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:12:32.056359 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a90269-9689-4211-acd3-f82f3c2336d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:12:32.056867 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a90269-9689-4211-acd3-f82f3c2336d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:12:32.057366 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a90269-9689-4211-acd3-f82f3c2336d3 admin admin] PATH_INFO: `/v3/projects/d5d1bf72fe0341d488df9c4d8c125a21` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:12:32.059757 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a90269-9689-4211-acd3-f82f3c2336d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d1bf72fe0341d488df9c4d8c125a21)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:12:32.062246 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: WARNING py.warnings [None req-34a90269-9689-4211-acd3-f82f3c2336d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:12:32.062246 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: warnings.warn(msg) Jul 28 11:12:32.062246 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: Jul 28 11:12:32.064787 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a90269-9689-4211-acd3-f82f3c2336d3 admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:12:32.158606 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-34a90269-9689-4211-acd3-f82f3c2336d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d1bf72fe0341d488df9c4d8c125a21', 'request_id': 'req-34a90269-9689-4211-acd3-f82f3c2336d3'} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:12:32.165662 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-34a90269-9689-4211-acd3-f82f3c2336d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d1bf72fe0341d488df9c4d8c125a21', 'request_id': 'req-34a90269-9689-4211-acd3-f82f3c2336d3'} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:12:32.177973 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-34a90269-9689-4211-acd3-f82f3c2336d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d1bf72fe0341d488df9c4d8c125a21', 'request_id': 'req-34a90269-9689-4211-acd3-f82f3c2336d3'} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:12:32.200205 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-34a90269-9689-4211-acd3-f82f3c2336d3 admin admin] The token cache is being invalidate because project d5d1bf72fe0341d488df9c4d8c125a21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 11:12:32.200555 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-34a90269-9689-4211-acd3-f82f3c2336d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:12:32.201500 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-34a90269-9689-4211-acd3-f82f3c2336d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:12:32.203327 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 555/1127] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Jul 28 11:12:32 2022] DELETE /identity/v3/projects/d5d1bf72fe0341d488df9c4d8c125a21 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:12:41.524954 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=25 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:12:42.196631 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:13:56.520371 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6e214-e183-486f-b4a7-cdf0694dbef5 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:13:56.521061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6e214-e183-486f-b4a7-cdf0694dbef5 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:13:56.521061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6e214-e183-486f-b4a7-cdf0694dbef5 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:13:56.522327 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 573/1128] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 11:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:13:56.528710 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb9958-94e4-4091-a87e-77bbc3d50cad None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:13:56.529474 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb9958-94e4-4091-a87e-77bbc3d50cad None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:13:56.529474 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb9958-94e4-4091-a87e-77bbc3d50cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:13:56.615133 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-62bb9958-94e4-4091-a87e-77bbc3d50cad None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:13:56.616430 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-62bb9958-94e4-4091-a87e-77bbc3d50cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:13:56.735808 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 556/1129] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 11:13:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:13:56.940416 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6e214-e183-486f-b4a7-cdf0694dbef5 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:13:56.942993 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-4cf6e214-e183-486f-b4a7-cdf0694dbef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:13:57.054388 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6e214-e183-486f-b4a7-cdf0694dbef5 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:13:57.060680 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24c5d5-37e1-4987-af16-6b9b1a9303d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:13:57.061345 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24c5d5-37e1-4987-af16-6b9b1a9303d1 service nova] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:13:57.061628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24c5d5-37e1-4987-af16-6b9b1a9303d1 service nova] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:13:57.061910 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24c5d5-37e1-4987-af16-6b9b1a9303d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:13:57.072872 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24c5d5-37e1-4987-af16-6b9b1a9303d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:13:57.074600 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24c5d5-37e1-4987-af16-6b9b1a9303d1 service nova] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:13:57.086168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 574/1130] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:13:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:13:58.178933 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa125e-8682-4e1a-8d6d-f0b0b7e01be9 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:13:58.179917 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa125e-8682-4e1a-8d6d-f0b0b7e01be9 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:13:58.179917 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa125e-8682-4e1a-8d6d-f0b0b7e01be9 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:13:58.181670 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 557/1131] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 11:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:13:58.189105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7f83e-430f-4c08-a73e-5823aeeaa9ce None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:13:58.189718 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7f83e-430f-4c08-a73e-5823aeeaa9ce None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:13:58.190086 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7f83e-430f-4c08-a73e-5823aeeaa9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:13:58.218344 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-aad7f83e-430f-4c08-a73e-5823aeeaa9ce None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:13:58.219766 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-aad7f83e-430f-4c08-a73e-5823aeeaa9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:13:58.229062 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 575/1132] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 11:13:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:13:58.403897 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa125e-8682-4e1a-8d6d-f0b0b7e01be9 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:13:58.419387 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa125e-8682-4e1a-8d6d-f0b0b7e01be9 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:13:58.427871 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff4ad4-379e-4450-ac5b-54e965aec0cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:13:58.428960 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff4ad4-379e-4450-ac5b-54e965aec0cc service nova] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:13:58.429447 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff4ad4-379e-4450-ac5b-54e965aec0cc service nova] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:13:58.429933 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff4ad4-379e-4450-ac5b-54e965aec0cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:13:58.445937 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff4ad4-379e-4450-ac5b-54e965aec0cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:13:58.448813 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff4ad4-379e-4450-ac5b-54e965aec0cc service nova] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:13:58.468149 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 558/1133] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:13:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:14:02.432297 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994dedc-178c-4a43-a625-05b0f2f95692 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:02.433185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994dedc-178c-4a43-a625-05b0f2f95692 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:02.433185 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994dedc-178c-4a43-a625-05b0f2f95692 None None] PATH_INFO: `/v3` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:02.434546 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 576/1134] 10.222.0.75 () {54 vars in 925 bytes} [Thu Jul 28 11:14:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:14:02.440849 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc84c1-fedb-4d1c-85e3-fb90b23adb71 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:02.441516 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc84c1-fedb-4d1c-85e3-fb90b23adb71 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:02.441516 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc84c1-fedb-4d1c-85e3-fb90b23adb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:02.475870 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-7dbc84c1-fedb-4d1c-85e3-fb90b23adb71 None None] MFA Rules not processed for user `8f4cb7d2680d4eb99a7328a54fcfd351`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:14:02.477180 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-7dbc84c1-fedb-4d1c-85e3-fb90b23adb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:14:02.554494 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=100 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:14:02.568687 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 559/1135] 10.222.0.75 () {58 vars in 1015 bytes} [Thu Jul 28 11:14:02 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:14:08.212496 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=42 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:14:09.853724 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c917304-a7c3-464b-8398-439af7340ebf None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:09.854470 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c917304-a7c3-464b-8398-439af7340ebf None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:09.854470 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c917304-a7c3-464b-8398-439af7340ebf None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:09.856079 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 577/1136] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 11:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:14:09.862034 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb341-ae79-4839-b5b2-4b6eefbc9bec None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:09.862660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb341-ae79-4839-b5b2-4b6eefbc9bec None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:09.862956 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb341-ae79-4839-b5b2-4b6eefbc9bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:09.885578 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-fe3eb341-ae79-4839-b5b2-4b6eefbc9bec None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:14:09.886879 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-fe3eb341-ae79-4839-b5b2-4b6eefbc9bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:14:09.896258 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 560/1137] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 11:14:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:14:10.063687 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c917304-a7c3-464b-8398-439af7340ebf None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:14:10.080150 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c917304-a7c3-464b-8398-439af7340ebf None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:14:10.086518 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ee3f2-7a84-4aeb-b505-a2eaeb79b881 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:14:10.087217 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ee3f2-7a84-4aeb-b505-a2eaeb79b881 service nova] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:10.087809 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ee3f2-7a84-4aeb-b505-a2eaeb79b881 service nova] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:10.088330 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ee3f2-7a84-4aeb-b505-a2eaeb79b881 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:10.099008 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ee3f2-7a84-4aeb-b505-a2eaeb79b881 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:14:10.100706 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ee3f2-7a84-4aeb-b505-a2eaeb79b881 service nova] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:14:10.112546 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 578/1138] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:14:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 11:14:11.089266 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aab5f-3dca-4555-8d97-ed539ff4b20e None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:11.089919 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aab5f-3dca-4555-8d97-ed539ff4b20e None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:11.089919 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aab5f-3dca-4555-8d97-ed539ff4b20e None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:11.091311 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 561/1139] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 11:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:14:11.097102 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa0e69-bb3f-4569-aa75-7d5a2c946ba8 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:11.098346 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa0e69-bb3f-4569-aa75-7d5a2c946ba8 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:11.098346 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa0e69-bb3f-4569-aa75-7d5a2c946ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:11.123013 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-4afa0e69-bb3f-4569-aa75-7d5a2c946ba8 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:14:11.124516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-4afa0e69-bb3f-4569-aa75-7d5a2c946ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:14:11.133634 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 579/1140] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 11:14:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:14:11.299318 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aab5f-3dca-4555-8d97-ed539ff4b20e None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:14:11.318384 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aab5f-3dca-4555-8d97-ed539ff4b20e None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:14:11.326192 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992452b-68d8-4b3a-b38c-77f91733ae4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:14:11.327072 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992452b-68d8-4b3a-b38c-77f91733ae4e service nova] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:11.327651 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992452b-68d8-4b3a-b38c-77f91733ae4e service nova] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:11.328129 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992452b-68d8-4b3a-b38c-77f91733ae4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:11.340385 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992452b-68d8-4b3a-b38c-77f91733ae4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:14:11.341970 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992452b-68d8-4b3a-b38c-77f91733ae4e service nova] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:14:11.355519 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 562/1141] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:14:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:14:11.717417 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee8e11-f4e5-471a-89bb-f607e733a6e3 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:11.717670 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee8e11-f4e5-471a-89bb-f607e733a6e3 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:11.718034 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee8e11-f4e5-471a-89bb-f607e733a6e3 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:11.719577 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 580/1142] 10.222.0.71 () {54 vars in 961 bytes} [Thu Jul 28 11:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:14:11.726164 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a998b-309e-451a-b687-5b01e8f65b6c None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:11.726750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a998b-309e-451a-b687-5b01e8f65b6c None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:11.727338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a998b-309e-451a-b687-5b01e8f65b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:11.753415 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-f16a998b-309e-451a-b687-5b01e8f65b6c None None] MFA Rules not processed for user `8f4cb7d2680d4eb99a7328a54fcfd351`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:14:11.754872 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-f16a998b-309e-451a-b687-5b01e8f65b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:14:11.764291 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 563/1143] 10.222.0.71 () {58 vars in 1058 bytes} [Thu Jul 28 11:14:11 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:14:11.773396 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee8e11-f4e5-471a-89bb-f607e733a6e3 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:14:11.797931 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee8e11-f4e5-471a-89bb-f607e733a6e3 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:14:11.806744 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67dde0-8f5d-4292-bdce-a147649a09d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4cb7d2680d4eb99a7328a54fcfd351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:14:11.807944 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67dde0-8f5d-4292-bdce-a147649a09d3 service placement] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:11.808476 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67dde0-8f5d-4292-bdce-a147649a09d3 service placement] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:11.809514 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67dde0-8f5d-4292-bdce-a147649a09d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:11.826593 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67dde0-8f5d-4292-bdce-a147649a09d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:14:11.829805 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67dde0-8f5d-4292-bdce-a147649a09d3 service placement] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:14:11.849123 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 581/1144] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:14:11 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:14:15.862250 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ca4cb-7f04-4d26-b432-d7bc30e1b7d0 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:15.862884 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ca4cb-7f04-4d26-b432-d7bc30e1b7d0 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:15.862884 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ca4cb-7f04-4d26-b432-d7bc30e1b7d0 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:15.864239 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 564/1145] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 11:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:14:15.870193 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed605ce-531a-44ca-8577-fbe828b6415f None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:15.870794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed605ce-531a-44ca-8577-fbe828b6415f None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:15.870794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed605ce-531a-44ca-8577-fbe828b6415f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:15.896305 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-aed605ce-531a-44ca-8577-fbe828b6415f None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:14:15.897598 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-aed605ce-531a-44ca-8577-fbe828b6415f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:14:15.905888 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 582/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 11:14:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:14:15.945461 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ca4cb-7f04-4d26-b432-d7bc30e1b7d0 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:14:15.947506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-e14ca4cb-7f04-4d26-b432-d7bc30e1b7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:14:16.020694 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ca4cb-7f04-4d26-b432-d7bc30e1b7d0 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:14:16.024506 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1c29f-993a-4d45-9089-7ebfb41761a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:14:16.025158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1c29f-993a-4d45-9089-7ebfb41761a8 service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:16.025443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1c29f-993a-4d45-9089-7ebfb41761a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:16.025720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1c29f-993a-4d45-9089-7ebfb41761a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:16.036443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1c29f-993a-4d45-9089-7ebfb41761a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:14:16.037981 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1c29f-993a-4d45-9089-7ebfb41761a8 service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:14:16.053382 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 565/1147] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:14:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:14:18.439715 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d227d-cb6c-4d14-b020-827744571dd6 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:18.440308 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d227d-cb6c-4d14-b020-827744571dd6 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:18.440308 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d227d-cb6c-4d14-b020-827744571dd6 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:18.441718 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 583/1148] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 11:14:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:14:18.447715 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a0165-586a-41a2-8f71-6378f39a738b None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:18.448285 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a0165-586a-41a2-8f71-6378f39a738b None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:18.448285 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a0165-586a-41a2-8f71-6378f39a738b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:18.469613 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-6c1a0165-586a-41a2-8f71-6378f39a738b None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:14:18.470865 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-6c1a0165-586a-41a2-8f71-6378f39a738b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:14:18.479110 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 566/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 11:14:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:14:18.526916 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d227d-cb6c-4d14-b020-827744571dd6 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:14:18.544475 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d227d-cb6c-4d14-b020-827744571dd6 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:14:18.549003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3838a-82b9-4c2b-ba5f-e30321e0b23b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:14:18.549685 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3838a-82b9-4c2b-ba5f-e30321e0b23b service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:18.549990 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3838a-82b9-4c2b-ba5f-e30321e0b23b service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:18.550293 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3838a-82b9-4c2b-ba5f-e30321e0b23b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:18.567575 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3838a-82b9-4c2b-ba5f-e30321e0b23b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:14:18.570361 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3838a-82b9-4c2b-ba5f-e30321e0b23b service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:14:18.589026 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 584/1150] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:14:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:14:22.653806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aba71-710f-4ad9-9910-59784d64e142 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:22.654585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aba71-710f-4ad9-9910-59784d64e142 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:22.654585 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aba71-710f-4ad9-9910-59784d64e142 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:22.656591 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 567/1151] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 11:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:14:22.662621 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e287bff-5ef9-4727-ba2e-d5d4544985d8 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:22.663196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e287bff-5ef9-4727-ba2e-d5d4544985d8 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:22.663196 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e287bff-5ef9-4727-ba2e-d5d4544985d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:22.684047 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-0e287bff-5ef9-4727-ba2e-d5d4544985d8 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:14:22.685333 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-0e287bff-5ef9-4727-ba2e-d5d4544985d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:14:22.693664 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 585/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 11:14:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:14:22.992897 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aba71-710f-4ad9-9910-59784d64e142 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:14:22.995157 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-778aba71-710f-4ad9-9910-59784d64e142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:14:23.067629 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aba71-710f-4ad9-9910-59784d64e142 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:14:23.071670 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99316984-3860-47ed-a28a-9a40979027e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a13ee61417bf4b1696004d6d73cf2299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:14:23.072524 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99316984-3860-47ed-a28a-9a40979027e2 service cinder] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:23.072873 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99316984-3860-47ed-a28a-9a40979027e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:23.073205 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99316984-3860-47ed-a28a-9a40979027e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:23.083394 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99316984-3860-47ed-a28a-9a40979027e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:14:23.084891 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99316984-3860-47ed-a28a-9a40979027e2 service cinder] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:14:23.095900 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 568/1153] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:14:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:14:25.733039 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34014324-3c54-46d3-8094-92315094df6d None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:25.733667 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34014324-3c54-46d3-8094-92315094df6d None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:25.733985 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34014324-3c54-46d3-8094-92315094df6d None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:25.736483 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 586/1154] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 11:14:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:14:25.744096 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2880902-5910-4ceb-8bfd-24a4089f6073 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:25.744660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2880902-5910-4ceb-8bfd-24a4089f6073 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:25.745158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2880902-5910-4ceb-8bfd-24a4089f6073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:25.778875 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-d2880902-5910-4ceb-8bfd-24a4089f6073 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:14:25.781010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-d2880902-5910-4ceb-8bfd-24a4089f6073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:14:25.794273 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 569/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 11:14:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:14:26.082311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34014324-3c54-46d3-8094-92315094df6d None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:14:26.084295 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-34014324-3c54-46d3-8094-92315094df6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:14:26.107287 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34014324-3c54-46d3-8094-92315094df6d None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:14:26.113363 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a3e12-75bf-4101-8d35-4046725b79e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a13ee61417bf4b1696004d6d73cf2299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:14:26.114435 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a3e12-75bf-4101-8d35-4046725b79e9 service cinder] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:14:26.114942 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a3e12-75bf-4101-8d35-4046725b79e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:14:26.115491 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a3e12-75bf-4101-8d35-4046725b79e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:14:26.132454 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a3e12-75bf-4101-8d35-4046725b79e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:14:26.135212 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a3e12-75bf-4101-8d35-4046725b79e9 service cinder] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:14:26.154944 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 587/1156] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:14:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:14:35.769988 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=70 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:14:36.146045 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=33 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:15:52.074251 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596826a6-0bed-4d4c-ae68-e4c0c072001b None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.074918 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596826a6-0bed-4d4c-ae68-e4c0c072001b None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.074918 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596826a6-0bed-4d4c-ae68-e4c0c072001b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.094240 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc40645-c4f5-4093-9b92-8806ec21be30 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.095176 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc40645-c4f5-4093-9b92-8806ec21be30 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.095176 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc40645-c4f5-4093-9b92-8806ec21be30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.102880 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-596826a6-0bed-4d4c-ae68-e4c0c072001b None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:15:52.113062 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-596826a6-0bed-4d4c-ae68-e4c0c072001b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:15:52.116287 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-8fc40645-c4f5-4093-9b92-8806ec21be30 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:15:52.118263 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-8fc40645-c4f5-4093-9b92-8806ec21be30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:15:52.127469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 570/1157] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:15:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:15:52.132580 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 588/1158] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:15:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:15:52.140667 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced7420-357b-409a-8681-24bc475b281f None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.141168 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced7420-357b-409a-8681-24bc475b281f None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.141663 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced7420-357b-409a-8681-24bc475b281f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.147310 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc889d9-a4a9-4e40-b6a1-1f80fdb01465 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.147729 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc889d9-a4a9-4e40-b6a1-1f80fdb01465 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.148116 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc889d9-a4a9-4e40-b6a1-1f80fdb01465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.164748 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-1ced7420-357b-409a-8681-24bc475b281f None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:15:52.166007 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-1ced7420-357b-409a-8681-24bc475b281f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:15:52.171870 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-cbc889d9-a4a9-4e40-b6a1-1f80fdb01465 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:15:52.173113 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-cbc889d9-a4a9-4e40-b6a1-1f80fdb01465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:15:52.175221 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 571/1159] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:15:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:15:52.180180 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced7420-357b-409a-8681-24bc475b281f None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:15:52.181802 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 589/1160] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:15:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:15:52.187343 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc889d9-a4a9-4e40-b6a1-1f80fdb01465 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:15:52.190704 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced7420-357b-409a-8681-24bc475b281f None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:15:52.195571 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074621d-4d8c-43ac-91f1-093814739ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:15:52.196206 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074621d-4d8c-43ac-91f1-093814739ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.196493 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074621d-4d8c-43ac-91f1-093814739ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.196774 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074621d-4d8c-43ac-91f1-093814739ef4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.197482 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074621d-4d8c-43ac-91f1-093814739ef4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:15:52.198334 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074621d-4d8c-43ac-91f1-093814739ef4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:15:52.200134 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074621d-4d8c-43ac-91f1-093814739ef4 admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:15:52.200836 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc889d9-a4a9-4e40-b6a1-1f80fdb01465 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:15:52.208943 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6107f-7a27-4833-b7df-e5b0503d81e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:15:52.209996 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6107f-7a27-4833-b7df-e5b0503d81e2 admin admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.210485 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6107f-7a27-4833-b7df-e5b0503d81e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.210975 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6107f-7a27-4833-b7df-e5b0503d81e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.212315 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6107f-7a27-4833-b7df-e5b0503d81e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 11:15:52.212850 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6107f-7a27-4833-b7df-e5b0503d81e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:15:52.219520 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 572/1161] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Jul 28 11:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:15:52.219794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: WARNING py.warnings [None req-93b6107f-7a27-4833-b7df-e5b0503d81e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:15:52.219794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: warnings.warn(msg) Jul 28 11:15:52.219794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: Jul 28 11:15:52.219794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6107f-7a27-4833-b7df-e5b0503d81e2 admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:15:52.222359 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074621d-4d8c-43ac-91f1-093814739ef4 admin admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:15:52.232624 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074621d-4d8c-43ac-91f1-093814739ef4 admin admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:15:52.236682 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 590/1162] 10.222.0.71 () {58 vars in 1153 bytes} [Thu Jul 28 11:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 11:15:52.237592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0277b67-8f79-4103-b5e5-9ad7d8de5b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:15:52.238243 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0277b67-8f79-4103-b5e5-9ad7d8de5b2e admin admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.238527 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0277b67-8f79-4103-b5e5-9ad7d8de5b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.238806 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0277b67-8f79-4103-b5e5-9ad7d8de5b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.239536 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0277b67-8f79-4103-b5e5-9ad7d8de5b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:15:52.240587 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: WARNING py.warnings [None req-b0277b67-8f79-4103-b5e5-9ad7d8de5b2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:15:52.240587 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: warnings.warn(msg) Jul 28 11:15:52.240587 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: Jul 28 11:15:52.241803 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0277b67-8f79-4103-b5e5-9ad7d8de5b2e admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:15:52.244829 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6107f-7a27-4833-b7df-e5b0503d81e2 admin admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:15:52.255404 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6107f-7a27-4833-b7df-e5b0503d81e2 admin admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:15:52.260913 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2501ee-63e3-4858-9812-7b8f9d32dba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:15:52.261568 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2501ee-63e3-4858-9812-7b8f9d32dba7 admin admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.261851 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2501ee-63e3-4858-9812-7b8f9d32dba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.262131 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2501ee-63e3-4858-9812-7b8f9d32dba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.262815 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2501ee-63e3-4858-9812-7b8f9d32dba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:15:52.264959 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2501ee-63e3-4858-9812-7b8f9d32dba7 admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:15:52.288714 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 573/1163] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Jul 28 11:15:52 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:15:52.294437 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0277b67-8f79-4103-b5e5-9ad7d8de5b2e admin admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:15:52.298663 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 591/1164] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Jul 28 11:15:52 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 11:15:52.304788 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2501ee-63e3-4858-9812-7b8f9d32dba7 admin admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:15:52.371391 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0277b67-8f79-4103-b5e5-9ad7d8de5b2e admin admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:15:52.387763 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2501ee-63e3-4858-9812-7b8f9d32dba7 admin admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:15:52.392517 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ede14-e9ed-48f5-ad6f-a436a9174db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:15:52.393144 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ede14-e9ed-48f5-ad6f-a436a9174db4 admin admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.393670 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ede14-e9ed-48f5-ad6f-a436a9174db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.393959 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ede14-e9ed-48f5-ad6f-a436a9174db4 admin admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.394638 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ede14-e9ed-48f5-ad6f-a436a9174db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:15:52.395716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: WARNING py.warnings [None req-085ede14-e9ed-48f5-ad6f-a436a9174db4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:15:52.395716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: warnings.warn(msg) Jul 28 11:15:52.395716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: Jul 28 11:15:52.396900 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ede14-e9ed-48f5-ad6f-a436a9174db4 admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:15:52.427316 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 592/1165] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Jul 28 11:15:52 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 11:15:52.428938 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ede14-e9ed-48f5-ad6f-a436a9174db4 admin admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:15:52.436402 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb82744-76fc-4a6b-abcd-e03680b15535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:15:52.437044 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb82744-76fc-4a6b-abcd-e03680b15535 admin admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.437330 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb82744-76fc-4a6b-abcd-e03680b15535 admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.437609 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb82744-76fc-4a6b-abcd-e03680b15535 admin admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.438311 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb82744-76fc-4a6b-abcd-e03680b15535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:15:52.440337 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb82744-76fc-4a6b-abcd-e03680b15535 admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:15:52.440979 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ede14-e9ed-48f5-ad6f-a436a9174db4 admin admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:15:52.449920 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd163974-aa78-4b21-b27d-fe4fa6e87543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:15:52.450553 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd163974-aa78-4b21-b27d-fe4fa6e87543 admin admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.450839 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd163974-aa78-4b21-b27d-fe4fa6e87543 admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.451126 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd163974-aa78-4b21-b27d-fe4fa6e87543 admin admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.452057 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd163974-aa78-4b21-b27d-fe4fa6e87543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:15:52.456980 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd163974-aa78-4b21-b27d-fe4fa6e87543 admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:15:52.466413 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 574/1166] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Jul 28 11:15:52 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 11:15:52.468959 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 593/1167] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Jul 28 11:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 11:15:52.470731 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb82744-76fc-4a6b-abcd-e03680b15535 admin admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:15:52.472747 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd163974-aa78-4b21-b27d-fe4fa6e87543 admin admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:15:52.481817 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb82744-76fc-4a6b-abcd-e03680b15535 admin admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:15:52.483535 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd163974-aa78-4b21-b27d-fe4fa6e87543 admin admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:15:52.486749 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49374eba-7559-4743-9e7d-98d7d5627472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:15:52.487473 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49374eba-7559-4743-9e7d-98d7d5627472 admin admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.487868 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49374eba-7559-4743-9e7d-98d7d5627472 admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.488157 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49374eba-7559-4743-9e7d-98d7d5627472 admin admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.488611 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce5a17-4fad-4649-b892-4df0e1f9c83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:15:52.488857 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49374eba-7559-4743-9e7d-98d7d5627472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:15:52.489228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce5a17-4fad-4649-b892-4df0e1f9c83e admin admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.489509 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce5a17-4fad-4649-b892-4df0e1f9c83e admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.489812 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce5a17-4fad-4649-b892-4df0e1f9c83e admin admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.490481 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49374eba-7559-4743-9e7d-98d7d5627472 admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:15:52.490626 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce5a17-4fad-4649-b892-4df0e1f9c83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:15:52.492232 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce5a17-4fad-4649-b892-4df0e1f9c83e admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:15:52.503170 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 575/1168] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Jul 28 11:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 11:15:52.507705 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 594/1169] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Jul 28 11:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 11:15:52.507955 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49374eba-7559-4743-9e7d-98d7d5627472 admin admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:15:52.509209 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce5a17-4fad-4649-b892-4df0e1f9c83e admin admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:15:52.517840 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49374eba-7559-4743-9e7d-98d7d5627472 admin admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:15:52.521382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce5a17-4fad-4649-b892-4df0e1f9c83e admin admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:15:52.525295 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a56360-1692-4220-9d80-70a7e38e56b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:15:52.526869 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a56360-1692-4220-9d80-70a7e38e56b7 admin admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.527455 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a56360-1692-4220-9d80-70a7e38e56b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.527874 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e0b55-16d8-4f3d-ad21-d6e97e4c202f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:15:52.528001 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a56360-1692-4220-9d80-70a7e38e56b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.528674 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e0b55-16d8-4f3d-ad21-d6e97e4c202f admin admin] REQUEST_METHOD: `PUT` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.528825 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e0b55-16d8-4f3d-ad21-d6e97e4c202f admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.529136 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e0b55-16d8-4f3d-ad21-d6e97e4c202f admin admin] PATH_INFO: `/v3/projects/007b19c59bd14ed2b4592db85770f0ce/users/29c69d75f71740fb9ed79d970bc12db4/roles/05bb46007d644829b12b0d4ded0bd8d2` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.529254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a56360-1692-4220-9d80-70a7e38e56b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:15:52.532183 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a56360-1692-4220-9d80-70a7e38e56b7 admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:15:52.548723 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e0b55-16d8-4f3d-ad21-d6e97e4c202f admin admin] RBAC: Authorizing `identity:create_grant(project_id=007b19c59bd14ed2b4592db85770f0ce, user_id=29c69d75f71740fb9ed79d970bc12db4, role_id=05bb46007d644829b12b0d4ded0bd8d2)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:15:52.551475 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e0b55-16d8-4f3d-ad21-d6e97e4c202f admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:15:52.555910 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 576/1170] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Jul 28 11:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 11:15:52.557166 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a56360-1692-4220-9d80-70a7e38e56b7 admin admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:15:52.565552 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 595/1171] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Jul 28 11:15:52 2022] PUT /identity/v3/projects/007b19c59bd14ed2b4592db85770f0ce/users/29c69d75f71740fb9ed79d970bc12db4/roles/05bb46007d644829b12b0d4ded0bd8d2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 11:15:52.569214 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a56360-1692-4220-9d80-70a7e38e56b7 admin admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:15:52.571775 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e8b76-36b3-448c-ba54-9f85a272ea6b None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.572067 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e8b76-36b3-448c-ba54-9f85a272ea6b None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.572411 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e8b76-36b3-448c-ba54-9f85a272ea6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.583792 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:15:52.592410 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-f25e8b76-36b3-448c-ba54-9f85a272ea6b None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:15:52.593680 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-f25e8b76-36b3-448c-ba54-9f85a272ea6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:15:52.637684 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691744c7-0e33-4476-88a7-b3ab46fc60b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:15:52.638498 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691744c7-0e33-4476-88a7-b3ab46fc60b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.638623 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691744c7-0e33-4476-88a7-b3ab46fc60b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.638853 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691744c7-0e33-4476-88a7-b3ab46fc60b9 admin admin] PATH_INFO: `/v3/projects/756c72c8325f48f38b53ca96b5e06dba/users/648b88fec52849fb881c6a0c6444e357/roles/05bb46007d644829b12b0d4ded0bd8d2` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.646637 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:15:52.656173 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691744c7-0e33-4476-88a7-b3ab46fc60b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756c72c8325f48f38b53ca96b5e06dba, user_id=648b88fec52849fb881c6a0c6444e357, role_id=05bb46007d644829b12b0d4ded0bd8d2)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:15:52.657248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: WARNING py.warnings [None req-691744c7-0e33-4476-88a7-b3ab46fc60b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:15:52.657248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: warnings.warn(msg) Jul 28 11:15:52.657248 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: Jul 28 11:15:52.659215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691744c7-0e33-4476-88a7-b3ab46fc60b9 admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:15:52.660985 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 596/1172] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:15:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:15:52.672767 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e8b76-36b3-448c-ba54-9f85a272ea6b None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:15:52.679037 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 577/1173] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Jul 28 11:15:52 2022] PUT /identity/v3/projects/756c72c8325f48f38b53ca96b5e06dba/users/648b88fec52849fb881c6a0c6444e357/roles/05bb46007d644829b12b0d4ded0bd8d2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 11:15:52.685017 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a032f-cba7-4bf9-aa50-ec3ab2792498 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.685308 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a032f-cba7-4bf9-aa50-ec3ab2792498 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.685588 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a032f-cba7-4bf9-aa50-ec3ab2792498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.707705 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-886a032f-cba7-4bf9-aa50-ec3ab2792498 None None] MFA Rules not processed for user `5277cece91a843118766eb0b5a214210`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:15:52.708955 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-886a032f-cba7-4bf9-aa50-ec3ab2792498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:15:52.757036 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e8b76-36b3-448c-ba54-9f85a272ea6b None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:15:52.778792 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 578/1174] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:15:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:15:52.792279 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a032f-cba7-4bf9-aa50-ec3ab2792498 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:15:52.793983 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-886a032f-cba7-4bf9-aa50-ec3ab2792498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:15:52.816459 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778d746-4b1b-454a-b2ce-9498e0d32a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:15:52.817098 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778d746-4b1b-454a-b2ce-9498e0d32a8b service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.817377 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778d746-4b1b-454a-b2ce-9498e0d32a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.817648 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778d746-4b1b-454a-b2ce-9498e0d32a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.828303 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778d746-4b1b-454a-b2ce-9498e0d32a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:15:52.829773 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778d746-4b1b-454a-b2ce-9498e0d32a8b service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:15:52.840084 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 597/1175] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:15:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:15:52.878317 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a032f-cba7-4bf9-aa50-ec3ab2792498 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:15:52.884354 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d8ddb-3936-46e5-968f-ecc49ba7253d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:15:52.885536 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d8ddb-3936-46e5-968f-ecc49ba7253d service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:15:52.886561 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d8ddb-3936-46e5-968f-ecc49ba7253d service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:15:52.887072 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d8ddb-3936-46e5-968f-ecc49ba7253d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:15:52.905470 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d8ddb-3936-46e5-968f-ecc49ba7253d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:15:52.908535 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d8ddb-3936-46e5-968f-ecc49ba7253d service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:15:52.927683 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 579/1176] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:15:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 11:16:00.790671 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f01073-e5e9-4b58-a8fd-3cc5017a107a None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:00.791689 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f01073-e5e9-4b58-a8fd-3cc5017a107a None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:00.791689 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f01073-e5e9-4b58-a8fd-3cc5017a107a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:00.856123 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-13f01073-e5e9-4b58-a8fd-3cc5017a107a None None] MFA Rules not processed for user `648b88fec52849fb881c6a0c6444e357`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:16:00.857428 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-13f01073-e5e9-4b58-a8fd-3cc5017a107a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:16:01.015165 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 598/1177] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:16:00 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:16:01.022577 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d8ddb-3936-46e5-968f-ecc49ba7253d service neutron] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:01.037796 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d8ddb-3936-46e5-968f-ecc49ba7253d service neutron] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:01.048740 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9da8e-5bcb-4921-b05b-e7f4eb4eb66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:01.059899 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9da8e-5bcb-4921-b05b-e7f4eb4eb66a admin admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:01.060475 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9da8e-5bcb-4921-b05b-e7f4eb4eb66a admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:01.067835 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9da8e-5bcb-4921-b05b-e7f4eb4eb66a admin admin] PATH_INFO: `/v3/projects` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:01.068676 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9da8e-5bcb-4921-b05b-e7f4eb4eb66a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:01.070695 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9da8e-5bcb-4921-b05b-e7f4eb4eb66a admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:01.077946 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f3e2f-ce68-4a0f-bf4d-6cf0f79d3515 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:01.078427 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f3e2f-ce68-4a0f-bf4d-6cf0f79d3515 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:01.078916 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f3e2f-ce68-4a0f-bf4d-6cf0f79d3515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:01.128076 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 580/1178] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Jul 28 11:16:01 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:16:01.132799 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9da8e-5bcb-4921-b05b-e7f4eb4eb66a admin admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:01.157647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:16:01.162483 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-965f3e2f-ce68-4a0f-bf4d-6cf0f79d3515 None None] MFA Rules not processed for user `29c69d75f71740fb9ed79d970bc12db4`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:16:01.169136 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-965f3e2f-ce68-4a0f-bf4d-6cf0f79d3515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:16:01.241061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:16:01.286626 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9da8e-5bcb-4921-b05b-e7f4eb4eb66a admin admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:01.292518 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bdab2-f8c2-4a97-abb3-40895f583780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:01.293151 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bdab2-f8c2-4a97-abb3-40895f583780 admin admin] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:01.293445 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bdab2-f8c2-4a97-abb3-40895f583780 admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:01.293731 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bdab2-f8c2-4a97-abb3-40895f583780 admin admin] PATH_INFO: `/v3/users` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:01.294430 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bdab2-f8c2-4a97-abb3-40895f583780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:01.296534 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bdab2-f8c2-4a97-abb3-40895f583780 admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:01.318321 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 599/1179] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:16:01 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:16:01.321073 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f3e2f-ce68-4a0f-bf4d-6cf0f79d3515 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:01.343415 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f3e2f-ce68-4a0f-bf4d-6cf0f79d3515 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:01.345179 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 581/1180] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Jul 28 11:16:01 2022] POST /identity/v3/users => generated 295 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 11:16:01.352338 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bdab2-f8c2-4a97-abb3-40895f583780 admin admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:01.353672 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac1db1-6d38-4823-b2ac-4305fc16fc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:01.355210 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac1db1-6d38-4823-b2ac-4305fc16fc55 admin admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:01.355596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac1db1-6d38-4823-b2ac-4305fc16fc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:01.355976 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac1db1-6d38-4823-b2ac-4305fc16fc55 admin admin] PATH_INFO: `/v3/projects` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:01.356764 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac1db1-6d38-4823-b2ac-4305fc16fc55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:01.359802 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac1db1-6d38-4823-b2ac-4305fc16fc55 admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:01.387320 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bdab2-f8c2-4a97-abb3-40895f583780 admin admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:01.404593 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 600/1181] 10.222.0.71 () {60 vars in 1153 bytes} [Thu Jul 28 11:16:01 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 11:16:01.408030 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32b60d-3551-4189-b71d-5084043e56ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:01.409001 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac1db1-6d38-4823-b2ac-4305fc16fc55 admin admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:01.409310 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32b60d-3551-4189-b71d-5084043e56ee admin admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:01.409904 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32b60d-3551-4189-b71d-5084043e56ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:01.412161 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32b60d-3551-4189-b71d-5084043e56ee admin admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:01.413589 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32b60d-3551-4189-b71d-5084043e56ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:01.416648 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32b60d-3551-4189-b71d-5084043e56ee admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:01.450059 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 582/1182] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Jul 28 11:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 11:16:01.456915 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32b60d-3551-4189-b71d-5084043e56ee admin admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:01.494894 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32b60d-3551-4189-b71d-5084043e56ee admin admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:01.552835 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac1db1-6d38-4823-b2ac-4305fc16fc55 admin admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:01.562147 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158d09f-44c7-4ec8-9b57-b3f576789adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:01.563225 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158d09f-44c7-4ec8-9b57-b3f576789adf admin admin] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:01.563964 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158d09f-44c7-4ec8-9b57-b3f576789adf admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:01.564471 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158d09f-44c7-4ec8-9b57-b3f576789adf admin admin] PATH_INFO: `/v3/users` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:01.565950 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158d09f-44c7-4ec8-9b57-b3f576789adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:01.570120 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158d09f-44c7-4ec8-9b57-b3f576789adf admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:01.593286 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048ea05-3bc5-4fd9-b165-3a0f1c11ae80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:01.596187 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048ea05-3bc5-4fd9-b165-3a0f1c11ae80 admin admin] REQUEST_METHOD: `PUT` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:01.597190 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048ea05-3bc5-4fd9-b165-3a0f1c11ae80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:01.599614 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048ea05-3bc5-4fd9-b165-3a0f1c11ae80 admin admin] PATH_INFO: `/v3/projects/0b62b6e536ae47cdb8ebe3ece408dcdf/users/60e0308150384b288194f07c3715fbc8/roles/f2a8452a65264f9ea10467160b1bd735` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:01.622508 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 601/1183] 10.222.0.71 () {60 vars in 1144 bytes} [Thu Jul 28 11:16:01 2022] POST /identity/v3/users => generated 299 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 11:16:01.624887 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158d09f-44c7-4ec8-9b57-b3f576789adf admin admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:01.636518 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048ea05-3bc5-4fd9-b165-3a0f1c11ae80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b62b6e536ae47cdb8ebe3ece408dcdf, user_id=60e0308150384b288194f07c3715fbc8, role_id=f2a8452a65264f9ea10467160b1bd735)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:01.644979 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048ea05-3bc5-4fd9-b165-3a0f1c11ae80 admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:01.647843 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158d09f-44c7-4ec8-9b57-b3f576789adf admin admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:01.661958 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a6a52-ce17-4164-8421-22bdf8735e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:01.663241 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a6a52-ce17-4164-8421-22bdf8735e2b admin admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:01.663995 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a6a52-ce17-4164-8421-22bdf8735e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:01.664511 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a6a52-ce17-4164-8421-22bdf8735e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:01.666302 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a6a52-ce17-4164-8421-22bdf8735e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:01.669516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a6a52-ce17-4164-8421-22bdf8735e2b admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:01.675327 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 583/1184] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Jul 28 11:16:01 2022] PUT /identity/v3/projects/0b62b6e536ae47cdb8ebe3ece408dcdf/users/60e0308150384b288194f07c3715fbc8/roles/f2a8452a65264f9ea10467160b1bd735 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:16:01.680314 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048ea05-3bc5-4fd9-b165-3a0f1c11ae80 admin admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:01.696711 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 602/1185] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Jul 28 11:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 11:16:01.701416 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a6a52-ce17-4164-8421-22bdf8735e2b admin admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:01.712945 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a6a52-ce17-4164-8421-22bdf8735e2b admin admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:01.812395 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aee8b8-1bf6-4488-a862-0812096cfaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:01.814788 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aee8b8-1bf6-4488-a862-0812096cfaec admin admin] REQUEST_METHOD: `PUT` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:01.815882 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aee8b8-1bf6-4488-a862-0812096cfaec admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:01.816558 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aee8b8-1bf6-4488-a862-0812096cfaec admin admin] PATH_INFO: `/v3/projects/1ee0293c8a674ddf9ea9193a45824d6d/users/bff138c7d7a440a0b6840dcaee526ef2/roles/f2a8452a65264f9ea10467160b1bd735` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:01.824569 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048ea05-3bc5-4fd9-b165-3a0f1c11ae80 admin admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:01.830653 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82f646-f154-489c-8e30-84deeaf47ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:01.831495 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82f646-f154-489c-8e30-84deeaf47ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:01.831884 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82f646-f154-489c-8e30-84deeaf47ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:01.832275 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82f646-f154-489c-8e30-84deeaf47ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:01.833554 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82f646-f154-489c-8e30-84deeaf47ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:01.835763 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82f646-f154-489c-8e30-84deeaf47ab6 admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:01.854469 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 584/1186] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Jul 28 11:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 11:16:01.856151 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82f646-f154-489c-8e30-84deeaf47ab6 admin admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:01.858522 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aee8b8-1bf6-4488-a862-0812096cfaec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee0293c8a674ddf9ea9193a45824d6d, user_id=bff138c7d7a440a0b6840dcaee526ef2, role_id=f2a8452a65264f9ea10467160b1bd735)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:01.864538 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aee8b8-1bf6-4488-a862-0812096cfaec admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:01.868429 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82f646-f154-489c-8e30-84deeaf47ab6 admin admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:01.875099 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babd533-ff5e-47a0-ae45-64878fcde5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:01.876138 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babd533-ff5e-47a0-ae45-64878fcde5ff admin admin] REQUEST_METHOD: `PUT` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:01.876575 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babd533-ff5e-47a0-ae45-64878fcde5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:01.876957 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babd533-ff5e-47a0-ae45-64878fcde5ff admin admin] PATH_INFO: `/v3/projects/0b62b6e536ae47cdb8ebe3ece408dcdf/users/60e0308150384b288194f07c3715fbc8/roles/f2a8452a65264f9ea10467160b1bd735` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:01.879981 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babd533-ff5e-47a0-ae45-64878fcde5ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b62b6e536ae47cdb8ebe3ece408dcdf, user_id=60e0308150384b288194f07c3715fbc8, role_id=f2a8452a65264f9ea10467160b1bd735)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:01.883254 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babd533-ff5e-47a0-ae45-64878fcde5ff admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:01.891048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:16:01.899916 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 603/1187] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Jul 28 11:16:01 2022] PUT /identity/v3/projects/1ee0293c8a674ddf9ea9193a45824d6d/users/bff138c7d7a440a0b6840dcaee526ef2/roles/f2a8452a65264f9ea10467160b1bd735 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 11:16:01.905838 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aee8b8-1bf6-4488-a862-0812096cfaec admin admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:01.911253 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 585/1188] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Jul 28 11:16:01 2022] PUT /identity/v3/projects/0b62b6e536ae47cdb8ebe3ece408dcdf/users/60e0308150384b288194f07c3715fbc8/roles/f2a8452a65264f9ea10467160b1bd735 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:16:01.971106 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:16:02.058547 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aee8b8-1bf6-4488-a862-0812096cfaec admin admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:02.181351 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c78afa-ea54-4faf-af76-e1a311f2f229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:02.183927 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c78afa-ea54-4faf-af76-e1a311f2f229 admin admin] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:02.185114 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c78afa-ea54-4faf-af76-e1a311f2f229 admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:02.185540 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c78afa-ea54-4faf-af76-e1a311f2f229 admin admin] PATH_INFO: `/v3/roles` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:02.187083 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c78afa-ea54-4faf-af76-e1a311f2f229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:02.190578 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c78afa-ea54-4faf-af76-e1a311f2f229 admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:02.254689 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 604/1189] 10.222.0.71 () {58 vars in 1122 bytes} [Thu Jul 28 11:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 11:16:02.254871 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babd533-ff5e-47a0-ae45-64878fcde5ff admin admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:02.277478 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babd533-ff5e-47a0-ae45-64878fcde5ff admin admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:02.293104 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab25c3-f6bd-40a0-ab5d-0eeecd70578a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:02.293881 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab25c3-f6bd-40a0-ab5d-0eeecd70578a admin admin] REQUEST_METHOD: `PUT` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:02.294363 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab25c3-f6bd-40a0-ab5d-0eeecd70578a admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:02.295054 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab25c3-f6bd-40a0-ab5d-0eeecd70578a admin admin] PATH_INFO: `/v3/projects/1ee0293c8a674ddf9ea9193a45824d6d/users/bff138c7d7a440a0b6840dcaee526ef2/roles/f2a8452a65264f9ea10467160b1bd735` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:02.298887 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab25c3-f6bd-40a0-ab5d-0eeecd70578a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee0293c8a674ddf9ea9193a45824d6d, user_id=bff138c7d7a440a0b6840dcaee526ef2, role_id=f2a8452a65264f9ea10467160b1bd735)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:02.308770 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab25c3-f6bd-40a0-ab5d-0eeecd70578a admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:02.328339 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 586/1190] 10.222.0.71 () {60 vars in 1483 bytes} [Thu Jul 28 11:16:02 2022] PUT /identity/v3/projects/1ee0293c8a674ddf9ea9193a45824d6d/users/bff138c7d7a440a0b6840dcaee526ef2/roles/f2a8452a65264f9ea10467160b1bd735 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 11:16:09.351771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12555ec3-8e5e-4e74-a095-1a54f0139af5 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:09.351771 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12555ec3-8e5e-4e74-a095-1a54f0139af5 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:09.352718 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12555ec3-8e5e-4e74-a095-1a54f0139af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:09.429213 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-12555ec3-8e5e-4e74-a095-1a54f0139af5 None None] MFA Rules not processed for user `bff138c7d7a440a0b6840dcaee526ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:16:09.430965 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-12555ec3-8e5e-4e74-a095-1a54f0139af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:16:09.566807 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 605/1191] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:16:09 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:16:09.583035 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab25c3-f6bd-40a0-ab5d-0eeecd70578a admin admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:09.587411 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-d2ab25c3-f6bd-40a0-ab5d-0eeecd70578a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:16:09.645264 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e011e5-55ad-48ce-b39a-80b23b976e77 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:09.645821 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e011e5-55ad-48ce-b39a-80b23b976e77 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:09.646134 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e011e5-55ad-48ce-b39a-80b23b976e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:09.684702 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-e5e011e5-55ad-48ce-b39a-80b23b976e77 None None] MFA Rules not processed for user `60e0308150384b288194f07c3715fbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:16:09.686296 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-e5e011e5-55ad-48ce-b39a-80b23b976e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:16:09.717195 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab25c3-f6bd-40a0-ab5d-0eeecd70578a admin admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:09.723183 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94835da6-1a90-45e8-a5e7-668bad0ff259 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f33b105ddb4c81a9ead57fd2d888ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:09.723932 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94835da6-1a90-45e8-a5e7-668bad0ff259 service glance] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:09.724222 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94835da6-1a90-45e8-a5e7-668bad0ff259 service glance] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:09.724504 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94835da6-1a90-45e8-a5e7-668bad0ff259 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:09.738864 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:16:09.810729 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 606/1192] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:16:09 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:16:09.826350 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e011e5-55ad-48ce-b39a-80b23b976e77 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:09.827894 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94835da6-1a90-45e8-a5e7-668bad0ff259 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:09.828110 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-e5e011e5-55ad-48ce-b39a-80b23b976e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:16:09.829803 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94835da6-1a90-45e8-a5e7-668bad0ff259 service glance] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:09.843363 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e011e5-55ad-48ce-b39a-80b23b976e77 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:09.845631 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 587/1193] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:16:09 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:16:09.850197 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc8893-2e96-4a30-a270-3935d191f4ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f33b105ddb4c81a9ead57fd2d888ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:09.850949 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc8893-2e96-4a30-a270-3935d191f4ab service glance] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:09.851342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc8893-2e96-4a30-a270-3935d191f4ab service glance] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:09.851700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc8893-2e96-4a30-a270-3935d191f4ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:09.944877 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc8893-2e96-4a30-a270-3935d191f4ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:09.946380 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc8893-2e96-4a30-a270-3935d191f4ab service glance] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:09.957832 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 607/1194] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:16:09 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 11:16:19.836529 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=60,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:16:19.953449 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=43 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:16:21.756116 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c55b75-f2a7-4fc4-8854-c2e9f8a95a98 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:21.757018 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c55b75-f2a7-4fc4-8854-c2e9f8a95a98 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:21.757491 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c55b75-f2a7-4fc4-8854-c2e9f8a95a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:21.791223 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-32c55b75-f2a7-4fc4-8854-c2e9f8a95a98 None None] MFA Rules not processed for user `29c69d75f71740fb9ed79d970bc12db4`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:16:21.793333 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-32c55b75-f2a7-4fc4-8854-c2e9f8a95a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:16:21.807097 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 588/1195] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:16:21 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:16:22.324766 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca96934-2092-410e-9307-01ab006f7d5c None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:22.325673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca96934-2092-410e-9307-01ab006f7d5c None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:22.325673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca96934-2092-410e-9307-01ab006f7d5c None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:22.327830 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 608/1196] 10.222.0.71 () {54 vars in 962 bytes} [Thu Jul 28 11:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:16:22.336765 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5648f-b340-48bb-b7d8-6755162ced10 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:22.337512 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5648f-b340-48bb-b7d8-6755162ced10 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:22.338165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5648f-b340-48bb-b7d8-6755162ced10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:22.398924 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-18b5648f-b340-48bb-b7d8-6755162ced10 None None] MFA Rules not processed for user `2bf7f66ba696444f8055a498e292a182`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:16:22.400967 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-18b5648f-b340-48bb-b7d8-6755162ced10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:16:22.525508 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 589/1197] 10.222.0.71 () {58 vars in 1059 bytes} [Thu Jul 28 11:16:22 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:16:22.533745 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ab34c-6913-470f-a348-a80c3ec95fbd None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:22.534061 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ab34c-6913-470f-a348-a80c3ec95fbd None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:22.534346 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ab34c-6913-470f-a348-a80c3ec95fbd None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:22.535800 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 609/1198] 10.222.0.71 () {54 vars in 912 bytes} [Thu Jul 28 11:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:16:22.545652 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d17c43-7127-49b7-967f-b2b540e4e6cc None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:22.546103 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d17c43-7127-49b7-967f-b2b540e4e6cc None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:22.546559 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d17c43-7127-49b7-967f-b2b540e4e6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:22.590266 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-83d17c43-7127-49b7-967f-b2b540e4e6cc None None] MFA Rules not processed for user `2bf7f66ba696444f8055a498e292a182`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:16:22.594265 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-83d17c43-7127-49b7-967f-b2b540e4e6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:16:22.622620 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 590/1199] 10.222.0.71 () {58 vars in 1009 bytes} [Thu Jul 28 11:16:22 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:16:22.631703 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ab34c-6913-470f-a348-a80c3ec95fbd None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:22.651882 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ab34c-6913-470f-a348-a80c3ec95fbd None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:22.657990 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af454e47-fda7-4401-ad91-d47a24babce9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f33b105ddb4c81a9ead57fd2d888ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:22.659031 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af454e47-fda7-4401-ad91-d47a24babce9 service glance] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:22.659774 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af454e47-fda7-4401-ad91-d47a24babce9 service glance] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:22.660281 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af454e47-fda7-4401-ad91-d47a24babce9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:22.674446 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af454e47-fda7-4401-ad91-d47a24babce9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:22.679067 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af454e47-fda7-4401-ad91-d47a24babce9 service glance] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:22.695475 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 610/1200] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:16:22 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 11:16:23.120067 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23425604-b184-4398-84c7-a6c5d6090b69 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:23.120916 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23425604-b184-4398-84c7-a6c5d6090b69 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:23.121109 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23425604-b184-4398-84c7-a6c5d6090b69 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:23.122826 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 591/1201] 10.222.0.71 () {54 vars in 912 bytes} [Thu Jul 28 11:16:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:16:23.131750 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7192269-f9a7-4381-9e76-3cbd451f7b50 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:23.132187 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7192269-f9a7-4381-9e76-3cbd451f7b50 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:23.132539 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7192269-f9a7-4381-9e76-3cbd451f7b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:23.157142 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-d7192269-f9a7-4381-9e76-3cbd451f7b50 None None] MFA Rules not processed for user `bd087e64f5714585a53556a8dda546e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:16:23.159164 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-d7192269-f9a7-4381-9e76-3cbd451f7b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:16:23.229274 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 611/1202] 10.222.0.71 () {58 vars in 1009 bytes} [Thu Jul 28 11:16:23 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:16:23.243770 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23425604-b184-4398-84c7-a6c5d6090b69 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:23.257171 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23425604-b184-4398-84c7-a6c5d6090b69 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:23.261036 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e190bc-08e8-4c3c-b432-c581246e4785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:23.261666 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e190bc-08e8-4c3c-b432-c581246e4785 service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:23.261944 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e190bc-08e8-4c3c-b432-c581246e4785 service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:23.262215 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e190bc-08e8-4c3c-b432-c581246e4785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:23.270924 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e190bc-08e8-4c3c-b432-c581246e4785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:23.272627 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e190bc-08e8-4c3c-b432-c581246e4785 service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:23.283259 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 592/1203] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:16:23 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:16:23.854126 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bd992-3245-40ab-92f9-3510d111d901 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:23.854939 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bd992-3245-40ab-92f9-3510d111d901 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:23.854939 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bd992-3245-40ab-92f9-3510d111d901 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:23.856117 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 612/1204] 10.222.0.71 () {54 vars in 962 bytes} [Thu Jul 28 11:16:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:16:23.862330 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebda6d-79bc-49cc-8952-9d05fb307b68 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:23.862625 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebda6d-79bc-49cc-8952-9d05fb307b68 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:23.862897 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebda6d-79bc-49cc-8952-9d05fb307b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:23.883177 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e5e93-600d-4da3-aa6a-0adae027b1c5 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:23.883670 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e5e93-600d-4da3-aa6a-0adae027b1c5 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:23.884143 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e5e93-600d-4da3-aa6a-0adae027b1c5 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:23.887010 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 613/1205] 10.222.0.71 () {54 vars in 961 bytes} [Thu Jul 28 11:16:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:16:23.895231 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-8cebda6d-79bc-49cc-8952-9d05fb307b68 None None] MFA Rules not processed for user `2bf7f66ba696444f8055a498e292a182`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:16:23.895536 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d1c79-0396-42cf-b61e-acefcda50240 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:23.895940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d1c79-0396-42cf-b61e-acefcda50240 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:23.896338 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d1c79-0396-42cf-b61e-acefcda50240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:23.896722 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-8cebda6d-79bc-49cc-8952-9d05fb307b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:16:23.907745 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 593/1206] 10.222.0.71 () {58 vars in 1059 bytes} [Thu Jul 28 11:16:23 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:16:23.913838 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92f83f-2c03-473d-9ebf-1dcfc90eaef9 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:23.914150 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92f83f-2c03-473d-9ebf-1dcfc90eaef9 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:23.914810 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92f83f-2c03-473d-9ebf-1dcfc90eaef9 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:23.916949 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 594/1207] 10.222.0.71 () {54 vars in 912 bytes} [Thu Jul 28 11:16:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:16:23.923647 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c0c65-a315-4288-8ffa-f939faa89040 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:23.924023 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c0c65-a315-4288-8ffa-f939faa89040 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:23.924343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c0c65-a315-4288-8ffa-f939faa89040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:23.928381 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-e20d1c79-0396-42cf-b61e-acefcda50240 None None] MFA Rules not processed for user `8f4cb7d2680d4eb99a7328a54fcfd351`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:16:23.930539 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-e20d1c79-0396-42cf-b61e-acefcda50240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:16:23.954031 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-742c0c65-a315-4288-8ffa-f939faa89040 None None] MFA Rules not processed for user `2bf7f66ba696444f8055a498e292a182`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:16:23.955988 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-742c0c65-a315-4288-8ffa-f939faa89040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:16:23.968799 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 595/1208] 10.222.0.71 () {58 vars in 1009 bytes} [Thu Jul 28 11:16:23 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:16:23.983627 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c0c65-a315-4288-8ffa-f939faa89040 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:23.999678 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c0c65-a315-4288-8ffa-f939faa89040 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:24.006201 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3db3b-fa16-42ef-a54f-20bc2de6c765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:24.007244 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3db3b-fa16-42ef-a54f-20bc2de6c765 service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:24.007763 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3db3b-fa16-42ef-a54f-20bc2de6c765 service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:24.008227 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3db3b-fa16-42ef-a54f-20bc2de6c765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:24.026055 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3db3b-fa16-42ef-a54f-20bc2de6c765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:24.028840 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3db3b-fa16-42ef-a54f-20bc2de6c765 service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:24.052443 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 596/1209] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:16:23 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:16:24.070177 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 614/1210] 10.222.0.71 () {58 vars in 1058 bytes} [Thu Jul 28 11:16:23 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:16:24.083774 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3db3b-fa16-42ef-a54f-20bc2de6c765 service neutron] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:24.102816 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3db3b-fa16-42ef-a54f-20bc2de6c765 service neutron] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:24.111706 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51d166-774a-4246-a562-2e6525cf19b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4cb7d2680d4eb99a7328a54fcfd351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:24.112736 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51d166-774a-4246-a562-2e6525cf19b5 service placement] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:24.113236 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51d166-774a-4246-a562-2e6525cf19b5 service placement] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:24.113726 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51d166-774a-4246-a562-2e6525cf19b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:24.116848 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-ba51d166-774a-4246-a562-2e6525cf19b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:16:24.141660 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51d166-774a-4246-a562-2e6525cf19b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:24.143830 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51d166-774a-4246-a562-2e6525cf19b5 service placement] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:24.156893 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 597/1211] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:16:24 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:16:34.048994 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=58 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:16:34.151850 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=64 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:16:36.225303 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedec282-dc8c-4672-8cab-db72cf76c528 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:36.225952 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedec282-dc8c-4672-8cab-db72cf76c528 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:36.225952 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedec282-dc8c-4672-8cab-db72cf76c528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:36.251383 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-fedec282-dc8c-4672-8cab-db72cf76c528 None None] MFA Rules not processed for user `bd087e64f5714585a53556a8dda546e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:16:36.252772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-fedec282-dc8c-4672-8cab-db72cf76c528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:16:36.261504 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 615/1212] 10.222.0.75 () {58 vars in 1015 bytes} [Thu Jul 28 11:16:36 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:16:36.275035 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51d166-774a-4246-a562-2e6525cf19b5 service placement] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:36.289000 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51d166-774a-4246-a562-2e6525cf19b5 service placement] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:36.293979 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e29448-908a-4b87-8b00-60f8e9ed3cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:36.294909 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e29448-908a-4b87-8b00-60f8e9ed3cfc service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:36.295446 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e29448-908a-4b87-8b00-60f8e9ed3cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:36.295728 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e29448-908a-4b87-8b00-60f8e9ed3cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:36.310654 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e29448-908a-4b87-8b00-60f8e9ed3cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:36.313605 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e29448-908a-4b87-8b00-60f8e9ed3cfc service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:36.331580 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 598/1213] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:16:36 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:16:37.566581 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0cfca-2c35-44dd-b1d2-29abf6446662 None None] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:37.567516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0cfca-2c35-44dd-b1d2-29abf6446662 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:37.567697 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0cfca-2c35-44dd-b1d2-29abf6446662 None None] PATH_INFO: `/` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:37.570394 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 616/1214] 10.222.0.71 () {54 vars in 921 bytes} [Thu Jul 28 11:16:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 11:16:37.650216 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c63ee-12be-404a-81da-25ec4249f511 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:37.652189 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c63ee-12be-404a-81da-25ec4249f511 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:37.653165 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c63ee-12be-404a-81da-25ec4249f511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:37.687394 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-447c63ee-12be-404a-81da-25ec4249f511 None None] MFA Rules not processed for user `2bf7f66ba696444f8055a498e292a182`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:16:37.688677 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-447c63ee-12be-404a-81da-25ec4249f511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:16:37.703559 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 599/1215] 10.222.0.71 () {58 vars in 1018 bytes} [Thu Jul 28 11:16:37 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:16:37.733259 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0cfca-2c35-44dd-b1d2-29abf6446662 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:37.763473 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0cfca-2c35-44dd-b1d2-29abf6446662 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:37.770483 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639533e-e33d-4e1c-97db-78c39d8bc443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:37.771132 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639533e-e33d-4e1c-97db-78c39d8bc443 service nova] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:37.771519 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639533e-e33d-4e1c-97db-78c39d8bc443 service nova] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:37.771805 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639533e-e33d-4e1c-97db-78c39d8bc443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:37.783304 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639533e-e33d-4e1c-97db-78c39d8bc443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:37.799621 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639533e-e33d-4e1c-97db-78c39d8bc443 service nova] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:37.814772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 617/1216] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:16:37 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:16:44.870496 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b30b9-58f2-4732-a561-c33abd45831c None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:44.871472 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b30b9-58f2-4732-a561-c33abd45831c None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:44.871472 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b30b9-58f2-4732-a561-c33abd45831c None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:44.874558 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 600/1217] 10.222.0.71 () {54 vars in 921 bytes} [Thu Jul 28 11:16:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:16:44.887929 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdbb33-50a1-4a18-b498-9b161a49b8a3 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:44.888596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdbb33-50a1-4a18-b498-9b161a49b8a3 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:44.889081 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdbb33-50a1-4a18-b498-9b161a49b8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:44.923124 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-5dbdbb33-50a1-4a18-b498-9b161a49b8a3 None None] MFA Rules not processed for user `2bf7f66ba696444f8055a498e292a182`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:16:44.925487 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-5dbdbb33-50a1-4a18-b498-9b161a49b8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:16:44.945032 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 618/1218] 10.222.0.71 () {58 vars in 1018 bytes} [Thu Jul 28 11:16:44 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:16:44.974844 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b30b9-58f2-4732-a561-c33abd45831c None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:44.992354 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b30b9-58f2-4732-a561-c33abd45831c None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:44.999555 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfb1c4-dcc6-4d88-8796-85aa6dbd9b42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:45.000364 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfb1c4-dcc6-4d88-8796-85aa6dbd9b42 service nova] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:45.000900 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfb1c4-dcc6-4d88-8796-85aa6dbd9b42 service nova] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:45.001391 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfb1c4-dcc6-4d88-8796-85aa6dbd9b42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:45.019781 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfb1c4-dcc6-4d88-8796-85aa6dbd9b42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:45.023512 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfb1c4-dcc6-4d88-8796-85aa6dbd9b42 service nova] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:45.044912 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 601/1219] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:16:44 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:16:54.913918 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=12 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:16:55.035791 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=15 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:16:59.274328 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbdbb33-50a1-4a18-b498-9b161a49b8a3 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:16:59.284838 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbdbb33-50a1-4a18-b498-9b161a49b8a3 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:16:59.288898 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcab4df-cf58-4105-97bc-0c6b152f2de9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:16:59.289542 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcab4df-cf58-4105-97bc-0c6b152f2de9 service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:16:59.289826 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcab4df-cf58-4105-97bc-0c6b152f2de9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:16:59.290099 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcab4df-cf58-4105-97bc-0c6b152f2de9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:16:59.302688 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcab4df-cf58-4105-97bc-0c6b152f2de9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:16:59.305286 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcab4df-cf58-4105-97bc-0c6b152f2de9 service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:16:59.321558 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 619/1220] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:16:59 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:17:09.314831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=6 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:17:23.472000 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40877307-592a-45b1-977a-b9c9e5944d17 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:17:23.472953 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40877307-592a-45b1-977a-b9c9e5944d17 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:17:23.472953 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40877307-592a-45b1-977a-b9c9e5944d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:17:23.493665 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-40877307-592a-45b1-977a-b9c9e5944d17 None None] MFA Rules not processed for user `648b88fec52849fb881c6a0c6444e357`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:17:23.494901 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-40877307-592a-45b1-977a-b9c9e5944d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:17:23.502722 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 602/1221] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:17:23 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:17:23.963736 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd448cf-fb80-4f44-8348-875501bc8448 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:17:23.964409 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd448cf-fb80-4f44-8348-875501bc8448 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:17:23.964409 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd448cf-fb80-4f44-8348-875501bc8448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:17:23.985625 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-7fd448cf-fb80-4f44-8348-875501bc8448 None None] MFA Rules not processed for user `bd087e64f5714585a53556a8dda546e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:17:23.986991 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-7fd448cf-fb80-4f44-8348-875501bc8448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:17:23.994864 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 620/1222] 10.222.0.71 () {58 vars in 1009 bytes} [Thu Jul 28 11:17:23 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:17:24.011022 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40877307-592a-45b1-977a-b9c9e5944d17 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:17:24.022595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40877307-592a-45b1-977a-b9c9e5944d17 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:17:24.026544 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d2e9a-072d-4cbf-aad5-532b544b4117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:17:24.027343 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d2e9a-072d-4cbf-aad5-532b544b4117 service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:17:24.027669 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d2e9a-072d-4cbf-aad5-532b544b4117 service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:17:24.027985 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d2e9a-072d-4cbf-aad5-532b544b4117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:17:24.037205 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d2e9a-072d-4cbf-aad5-532b544b4117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:17:24.038708 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d2e9a-072d-4cbf-aad5-532b544b4117 service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:17:24.049373 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 603/1223] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:17:24 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 11:17:33.979770 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=3 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:17:34.044686 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=9 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:17:52.411549 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31371f00-f76f-4f3b-8d75-17ebee1306cb None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:17:52.412115 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31371f00-f76f-4f3b-8d75-17ebee1306cb None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:17:52.412533 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31371f00-f76f-4f3b-8d75-17ebee1306cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:17:52.446434 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-31371f00-f76f-4f3b-8d75-17ebee1306cb None None] MFA Rules not processed for user `648b88fec52849fb881c6a0c6444e357`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:17:52.448547 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-31371f00-f76f-4f3b-8d75-17ebee1306cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:17:52.460435 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 621/1224] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:17:52 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:18:02.437488 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=3 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:18:07.981341 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623525e-15be-4885-9a37-0a6314285d10 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:18:07.981911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623525e-15be-4885-9a37-0a6314285d10 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:18:07.981911 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623525e-15be-4885-9a37-0a6314285d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:18:08.002228 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-9623525e-15be-4885-9a37-0a6314285d10 None None] MFA Rules not processed for user `648b88fec52849fb881c6a0c6444e357`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:18:08.003681 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-9623525e-15be-4885-9a37-0a6314285d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:18:08.011518 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 604/1225] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:18:07 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:18:17.996923 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=3 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:19:09.676647 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a9aa8-1a39-4daa-84e9-cf140d0fad35 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:19:09.677256 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a9aa8-1a39-4daa-84e9-cf140d0fad35 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:19:09.677476 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a9aa8-1a39-4daa-84e9-cf140d0fad35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:19:09.698180 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-fa1a9aa8-1a39-4daa-84e9-cf140d0fad35 None None] MFA Rules not processed for user `648b88fec52849fb881c6a0c6444e357`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:19:09.699462 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-fa1a9aa8-1a39-4daa-84e9-cf140d0fad35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:19:09.706581 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 622/1226] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:19:09 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:19:11.173113 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623525e-15be-4885-9a37-0a6314285d10 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:19:11.200696 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623525e-15be-4885-9a37-0a6314285d10 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:19:11.206639 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107843b-8138-48b4-9984-9cf16054ada3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4cb7d2680d4eb99a7328a54fcfd351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:19:11.207344 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107843b-8138-48b4-9984-9cf16054ada3 service placement] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:19:11.207629 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107843b-8138-48b4-9984-9cf16054ada3 service placement] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:19:11.207914 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107843b-8138-48b4-9984-9cf16054ada3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:19:11.218470 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107843b-8138-48b4-9984-9cf16054ada3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:19:11.220379 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107843b-8138-48b4-9984-9cf16054ada3 service placement] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:19:11.232999 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 605/1227] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:19:11 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:19:19.691752 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=3 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:19:21.227859 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=10 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:19:24.404906 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a9aa8-1a39-4daa-84e9-cf140d0fad35 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:19:24.431228 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a9aa8-1a39-4daa-84e9-cf140d0fad35 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:19:24.435716 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5e0fc-cfd3-40c2-91d6-bf159ecae905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:19:24.436369 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5e0fc-cfd3-40c2-91d6-bf159ecae905 service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:19:24.436654 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5e0fc-cfd3-40c2-91d6-bf159ecae905 service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:19:24.437086 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5e0fc-cfd3-40c2-91d6-bf159ecae905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:19:24.449003 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5e0fc-cfd3-40c2-91d6-bf159ecae905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:19:24.450602 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5e0fc-cfd3-40c2-91d6-bf159ecae905 service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:19:24.461965 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 623/1228] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:19:24 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:19:34.456854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=10 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:21:32.640951 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107843b-8138-48b4-9984-9cf16054ada3 service placement] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:21:32.667202 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107843b-8138-48b4-9984-9cf16054ada3 service placement] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:21:32.672677 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe18e0-b6f0-4309-8d32-75270e8cb877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:21:32.673331 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe18e0-b6f0-4309-8d32-75270e8cb877 service nova] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:21:32.673618 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe18e0-b6f0-4309-8d32-75270e8cb877 service nova] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:21:32.673907 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe18e0-b6f0-4309-8d32-75270e8cb877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:21:32.683312 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe18e0-b6f0-4309-8d32-75270e8cb877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:21:32.684981 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe18e0-b6f0-4309-8d32-75270e8cb877 service nova] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:21:32.695836 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 606/1229] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:21:32 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:21:32.909457 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5e0fc-cfd3-40c2-91d6-bf159ecae905 service neutron] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:21:32.924688 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5e0fc-cfd3-40c2-91d6-bf159ecae905 service neutron] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:21:32.931748 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f98c4-4840-457b-be36-f28ae828eabc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:21:32.932854 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f98c4-4840-457b-be36-f28ae828eabc service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:21:32.933365 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f98c4-4840-457b-be36-f28ae828eabc service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:21:32.933868 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f98c4-4840-457b-be36-f28ae828eabc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:21:32.952772 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f98c4-4840-457b-be36-f28ae828eabc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:21:32.955628 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f98c4-4840-457b-be36-f28ae828eabc service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:21:32.975862 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 624/1230] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:21:32 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:21:34.197822 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe18e0-b6f0-4309-8d32-75270e8cb877 service nova] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:21:34.208107 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe18e0-b6f0-4309-8d32-75270e8cb877 service nova] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:21:34.212798 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5d1b8-49b4-4f8f-bd8f-af9e88cd942f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:21:34.213440 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5d1b8-49b4-4f8f-bd8f-af9e88cd942f service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:21:34.213731 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5d1b8-49b4-4f8f-bd8f-af9e88cd942f service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:21:34.214043 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5d1b8-49b4-4f8f-bd8f-af9e88cd942f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:21:34.226685 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5d1b8-49b4-4f8f-bd8f-af9e88cd942f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:21:34.228232 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5d1b8-49b4-4f8f-bd8f-af9e88cd942f service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:21:34.240507 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 607/1231] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:21:34 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:21:34.648736 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f98c4-4840-457b-be36-f28ae828eabc service neutron] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:21:34.660290 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f98c4-4840-457b-be36-f28ae828eabc service neutron] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:21:34.666489 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5080e3-9f30-42c9-99e3-bf54c53f993b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:21:34.667639 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5080e3-9f30-42c9-99e3-bf54c53f993b service nova] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:21:34.667818 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5080e3-9f30-42c9-99e3-bf54c53f993b service nova] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:21:34.668146 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5080e3-9f30-42c9-99e3-bf54c53f993b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:21:34.678910 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5080e3-9f30-42c9-99e3-bf54c53f993b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:21:34.680590 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5080e3-9f30-42c9-99e3-bf54c53f993b service nova] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:21:34.691318 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 625/1232] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:21:34 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:21:35.823726 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb93956-d98d-4709-991a-367d27da8b73 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:21:35.826320 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb93956-d98d-4709-991a-367d27da8b73 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:21:35.827309 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb93956-d98d-4709-991a-367d27da8b73 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:21:35.833661 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 608/1233] 10.222.0.71 () {54 vars in 921 bytes} [Thu Jul 28 11:21:35 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:21:35.848742 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0250f3-de1b-428d-8ba4-62e477c8ba2b None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:21:35.851014 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0250f3-de1b-428d-8ba4-62e477c8ba2b None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:21:35.851916 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0250f3-de1b-428d-8ba4-62e477c8ba2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:21:36.060897 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-9e0250f3-de1b-428d-8ba4-62e477c8ba2b None None] MFA Rules not processed for user `2bf7f66ba696444f8055a498e292a182`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:21:36.064553 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-9e0250f3-de1b-428d-8ba4-62e477c8ba2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:21:36.085077 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 626/1234] 10.222.0.71 () {58 vars in 1018 bytes} [Thu Jul 28 11:21:35 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:21:36.102485 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb93956-d98d-4709-991a-367d27da8b73 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:21:36.129190 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb93956-d98d-4709-991a-367d27da8b73 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:21:36.138171 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af49d2-223e-440c-a516-fbffa62a2f0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:21:36.139410 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af49d2-223e-440c-a516-fbffa62a2f0a service nova] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:21:36.139994 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af49d2-223e-440c-a516-fbffa62a2f0a service nova] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:21:36.140560 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af49d2-223e-440c-a516-fbffa62a2f0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:21:36.160001 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af49d2-223e-440c-a516-fbffa62a2f0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:21:36.164186 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af49d2-223e-440c-a516-fbffa62a2f0a service nova] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:21:36.187672 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 609/1235] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:21:36 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:21:36.311506 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0250f3-de1b-428d-8ba4-62e477c8ba2b None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:21:36.330634 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0250f3-de1b-428d-8ba4-62e477c8ba2b None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:21:36.337794 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a95db4-ceec-4963-9ff6-bd6c5a01fdbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:21:36.339043 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a95db4-ceec-4963-9ff6-bd6c5a01fdbe service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:21:36.339673 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a95db4-ceec-4963-9ff6-bd6c5a01fdbe service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:21:36.340276 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a95db4-ceec-4963-9ff6-bd6c5a01fdbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:21:36.354934 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a95db4-ceec-4963-9ff6-bd6c5a01fdbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:21:36.358019 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a95db4-ceec-4963-9ff6-bd6c5a01fdbe service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:21:36.374285 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 627/1236] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:21:36 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 11:21:38.410263 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9890fc-610b-4475-8b69-6a59e92f8200 None None] REQUEST_METHOD: `POST` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:21:38.411927 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9890fc-610b-4475-8b69-6a59e92f8200 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:21:38.413754 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9890fc-610b-4475-8b69-6a59e92f8200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:21:38.453737 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.auth.core [None req-bc9890fc-610b-4475-8b69-6a59e92f8200 None None] MFA Rules not processed for user `648b88fec52849fb881c6a0c6444e357`. Rule list: `[]` (Enabled: `True`). {{(pid=87206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:21:38.455763 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-bc9890fc-610b-4475-8b69-6a59e92f8200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:21:38.465268 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 610/1237] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:21:38 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:21:39.000715 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a95db4-ceec-4963-9ff6-bd6c5a01fdbe service neutron] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:21:39.022582 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a95db4-ceec-4963-9ff6-bd6c5a01fdbe service neutron] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:21:39.029322 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deab48-3b5f-4345-90b1-4a03c24e3c59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:21:39.030074 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deab48-3b5f-4345-90b1-4a03c24e3c59 service nova] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:21:39.030427 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deab48-3b5f-4345-90b1-4a03c24e3c59 service nova] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:21:39.030765 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deab48-3b5f-4345-90b1-4a03c24e3c59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:21:39.041391 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deab48-3b5f-4345-90b1-4a03c24e3c59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:21:39.043805 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deab48-3b5f-4345-90b1-4a03c24e3c59 service nova] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:21:39.060732 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 628/1238] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:21:38 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 11:21:39.087186 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9890fc-610b-4475-8b69-6a59e92f8200 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:21:39.111141 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9890fc-610b-4475-8b69-6a59e92f8200 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:21:39.121966 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e7e90-e608-406a-a43d-0ed495671be9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:21:39.122964 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e7e90-e608-406a-a43d-0ed495671be9 service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:21:39.123440 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e7e90-e608-406a-a43d-0ed495671be9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:21:39.123904 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e7e90-e608-406a-a43d-0ed495671be9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:21:39.140258 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e7e90-e608-406a-a43d-0ed495671be9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:21:39.143451 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e7e90-e608-406a-a43d-0ed495671be9 service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:21:39.162821 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 611/1239] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:21:39 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:21:40.029220 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deab48-3b5f-4345-90b1-4a03c24e3c59 service nova] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:21:40.070231 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deab48-3b5f-4345-90b1-4a03c24e3c59 service nova] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:21:40.077260 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbadc678-a169-4f47-8b66-8466548d8e54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4cb7d2680d4eb99a7328a54fcfd351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:21:40.078430 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadc678-a169-4f47-8b66-8466548d8e54 service placement] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:21:40.078951 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadc678-a169-4f47-8b66-8466548d8e54 service placement] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:21:40.079342 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadc678-a169-4f47-8b66-8466548d8e54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:21:40.114007 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbadc678-a169-4f47-8b66-8466548d8e54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:21:40.118610 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbadc678-a169-4f47-8b66-8466548d8e54 service placement] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:21:40.139005 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 629/1240] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:21:40 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:21:49.154417 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=31 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:21:50.131736 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=43 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:21:50.417760 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e7e90-e608-406a-a43d-0ed495671be9 service neutron] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:21:50.446921 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e7e90-e608-406a-a43d-0ed495671be9 service neutron] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:21:50.458413 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dc4dd-b73d-4def-9244-9a5e9c078ef1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bf7f66ba696444f8055a498e292a182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:21:50.461132 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dc4dd-b73d-4def-9244-9a5e9c078ef1 service nova] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:21:50.461132 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dc4dd-b73d-4def-9244-9a5e9c078ef1 service nova] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:21:50.461530 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dc4dd-b73d-4def-9244-9a5e9c078ef1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:21:50.481883 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dc4dd-b73d-4def-9244-9a5e9c078ef1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:21:50.484858 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dc4dd-b73d-4def-9244-9a5e9c078ef1 service nova] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:21:50.506249 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 612/1241] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:21:50 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:21:54.131294 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04b45d-a8f8-4fbc-8c8d-7a3e7614ac70 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:21:54.132153 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04b45d-a8f8-4fbc-8c8d-7a3e7614ac70 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:21:54.132312 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04b45d-a8f8-4fbc-8c8d-7a3e7614ac70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:21:54.165929 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-9f04b45d-a8f8-4fbc-8c8d-7a3e7614ac70 None None] MFA Rules not processed for user `29c69d75f71740fb9ed79d970bc12db4`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:21:54.168138 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-9f04b45d-a8f8-4fbc-8c8d-7a3e7614ac70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:21:54.185728 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 630/1242] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:21:54 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:22:00.500849 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=6 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:22:04.157826 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=3 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:22:21.154308 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dc4dd-b73d-4def-9244-9a5e9c078ef1 service nova] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:22:21.171015 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dc4dd-b73d-4def-9244-9a5e9c078ef1 service nova] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:22:21.177745 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182985e0-f5de-4b77-a7a9-969ced0846ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:22:21.178797 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182985e0-f5de-4b77-a7a9-969ced0846ba service neutron] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:22:21.179319 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182985e0-f5de-4b77-a7a9-969ced0846ba service neutron] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:22:21.179816 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182985e0-f5de-4b77-a7a9-969ced0846ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:22:21.197010 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182985e0-f5de-4b77-a7a9-969ced0846ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:22:21.199811 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182985e0-f5de-4b77-a7a9-969ced0846ba service neutron] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:22:21.218770 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 613/1243] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:22:21 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:22:31.210034 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=6 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:23:39.578648 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd53996-dc65-48bb-a12b-e6498ef02e81 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:23:39.579379 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd53996-dc65-48bb-a12b-e6498ef02e81 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:23:39.579518 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd53996-dc65-48bb-a12b-e6498ef02e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:23:39.601699 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-4dd53996-dc65-48bb-a12b-e6498ef02e81 None None] MFA Rules not processed for user `648b88fec52849fb881c6a0c6444e357`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:23:39.603254 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-4dd53996-dc65-48bb-a12b-e6498ef02e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:23:39.610799 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 631/1244] 10.222.0.71 () {58 vars in 958 bytes} [Thu Jul 28 11:23:39 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:23:49.595178 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=3 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:24:13.749977 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182985e0-f5de-4b77-a7a9-969ced0846ba service neutron] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:24:13.816209 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182985e0-f5de-4b77-a7a9-969ced0846ba service neutron] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:24:13.824077 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ca298-c673-4665-949e-72715e1f6f33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4cb7d2680d4eb99a7328a54fcfd351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:24:13.824737 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ca298-c673-4665-949e-72715e1f6f33 service placement] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:24:13.825028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ca298-c673-4665-949e-72715e1f6f33 service placement] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:24:13.825312 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ca298-c673-4665-949e-72715e1f6f33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:24:13.827510 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-a61ca298-c673-4665-949e-72715e1f6f33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:24:13.881859 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ca298-c673-4665-949e-72715e1f6f33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:24:13.883576 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ca298-c673-4665-949e-72715e1f6f33 service placement] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:24:13.894619 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 614/1245] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:24:13 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:24:23.890108 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=33 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:24:53.168401 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd53996-dc65-48bb-a12b-e6498ef02e81 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:24:53.188753 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd53996-dc65-48bb-a12b-e6498ef02e81 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:24:53.194125 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba636bb-debb-4ed4-bd62-83036674c6f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:24:53.194828 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba636bb-debb-4ed4-bd62-83036674c6f3 service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:24:53.195218 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba636bb-debb-4ed4-bd62-83036674c6f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:24:53.195596 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba636bb-debb-4ed4-bd62-83036674c6f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:24:53.285700 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba636bb-debb-4ed4-bd62-83036674c6f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:24:53.287093 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba636bb-debb-4ed4-bd62-83036674c6f3 service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:24:53.311033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 632/1246] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:24:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:24:57.593089 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26598ba-a7bd-4a57-9056-c78e5b3ac2ba None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:24:57.593977 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26598ba-a7bd-4a57-9056-c78e5b3ac2ba None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:24:57.593977 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26598ba-a7bd-4a57-9056-c78e5b3ac2ba None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:24:57.595158 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 615/1247] 10.222.0.71 () {54 vars in 921 bytes} [Thu Jul 28 11:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:24:57.609488 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdd0a0-3f8a-4dfc-b902-79e291db2861 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:24:57.612075 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdd0a0-3f8a-4dfc-b902-79e291db2861 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:24:57.613018 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdd0a0-3f8a-4dfc-b902-79e291db2861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:24:57.719062 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-07bdd0a0-3f8a-4dfc-b902-79e291db2861 None None] MFA Rules not processed for user `8f4cb7d2680d4eb99a7328a54fcfd351`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:24:57.722852 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-07bdd0a0-3f8a-4dfc-b902-79e291db2861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:24:57.742902 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 633/1248] 10.222.0.71 () {58 vars in 1018 bytes} [Thu Jul 28 11:24:57 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 11:24:57.761027 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26598ba-a7bd-4a57-9056-c78e5b3ac2ba None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:24:57.788063 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26598ba-a7bd-4a57-9056-c78e5b3ac2ba None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:24:57.795979 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15748c-5549-4b4b-9726-07c7dfb8bb22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4cb7d2680d4eb99a7328a54fcfd351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:24:57.797039 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15748c-5549-4b4b-9726-07c7dfb8bb22 service placement] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:24:57.797513 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15748c-5549-4b4b-9726-07c7dfb8bb22 service placement] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:24:57.797954 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15748c-5549-4b4b-9726-07c7dfb8bb22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:24:57.813592 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15748c-5549-4b4b-9726-07c7dfb8bb22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:24:57.817882 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15748c-5549-4b4b-9726-07c7dfb8bb22 service placement] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:24:57.838380 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 616/1249] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:24:57 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:25:02.258098 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdd0a0-3f8a-4dfc-b902-79e291db2861 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:25:02.277842 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdd0a0-3f8a-4dfc-b902-79e291db2861 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:25:02.289144 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1c1a7-e970-4204-90f3-2c023fca0c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:25:02.290311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1c1a7-e970-4204-90f3-2c023fca0c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:25:02.290840 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1c1a7-e970-4204-90f3-2c023fca0c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:25:02.291369 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1c1a7-e970-4204-90f3-2c023fca0c43 admin admin] PATH_INFO: `/v3/users/29c69d75f71740fb9ed79d970bc12db4` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:25:02.293323 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1c1a7-e970-4204-90f3-2c023fca0c43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29c69d75f71740fb9ed79d970bc12db4)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:25:02.296764 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1c1a7-e970-4204-90f3-2c023fca0c43 admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:25:02.531235 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-c6d1c1a7-e970-4204-90f3-2c023fca0c43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29c69d75f71740fb9ed79d970bc12db4'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:02.542649 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-c6d1c1a7-e970-4204-90f3-2c023fca0c43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29c69d75f71740fb9ed79d970bc12db4'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:02.563033 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-c6d1c1a7-e970-4204-90f3-2c023fca0c43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29c69d75f71740fb9ed79d970bc12db4'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:02.576309 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-c6d1c1a7-e970-4204-90f3-2c023fca0c43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29c69d75f71740fb9ed79d970bc12db4'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:02.577282 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-c6d1c1a7-e970-4204-90f3-2c023fca0c43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29c69d75f71740fb9ed79d970bc12db4'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:02.587659 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 634/1250] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Jul 28 11:25:02 2022] DELETE /identity/v3/users/29c69d75f71740fb9ed79d970bc12db4 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:25:02.889657 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15748c-5549-4b4b-9726-07c7dfb8bb22 service placement] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:25:02.910769 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15748c-5549-4b4b-9726-07c7dfb8bb22 service placement] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:25:03.003634 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b966d4-32b3-4c0a-b25e-842990f04388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:25:03.004341 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b966d4-32b3-4c0a-b25e-842990f04388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:25:03.004850 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b966d4-32b3-4c0a-b25e-842990f04388 admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:25:03.005138 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b966d4-32b3-4c0a-b25e-842990f04388 admin admin] PATH_INFO: `/v3/projects/007b19c59bd14ed2b4592db85770f0ce` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:25:03.006648 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b966d4-32b3-4c0a-b25e-842990f04388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=007b19c59bd14ed2b4592db85770f0ce)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:25:03.008859 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b966d4-32b3-4c0a-b25e-842990f04388 admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:25:03.087044 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-61b966d4-32b3-4c0a-b25e-842990f04388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '007b19c59bd14ed2b4592db85770f0ce', 'request_id': 'req-61b966d4-32b3-4c0a-b25e-842990f04388'} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:03.099494 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-61b966d4-32b3-4c0a-b25e-842990f04388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '007b19c59bd14ed2b4592db85770f0ce', 'request_id': 'req-61b966d4-32b3-4c0a-b25e-842990f04388'} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:03.111017 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-61b966d4-32b3-4c0a-b25e-842990f04388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '007b19c59bd14ed2b4592db85770f0ce', 'request_id': 'req-61b966d4-32b3-4c0a-b25e-842990f04388'} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:03.161150 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-61b966d4-32b3-4c0a-b25e-842990f04388 admin admin] The token cache is being invalidate because project 007b19c59bd14ed2b4592db85770f0ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 11:25:03.161583 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-61b966d4-32b3-4c0a-b25e-842990f04388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:03.162447 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-61b966d4-32b3-4c0a-b25e-842990f04388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:03.164048 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 617/1251] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Jul 28 11:25:02 2022] DELETE /identity/v3/projects/007b19c59bd14ed2b4592db85770f0ce => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:25:03.168826 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1c1a7-e970-4204-90f3-2c023fca0c43 admin admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:25:03.170569 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-c6d1c1a7-e970-4204-90f3-2c023fca0c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:25:03.190022 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1c1a7-e970-4204-90f3-2c023fca0c43 admin admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:25:03.207980 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:03.271532 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83355f-1d21-43ee-904c-9d05b5e8d9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:25:03.272369 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83355f-1d21-43ee-904c-9d05b5e8d9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:25:03.272657 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83355f-1d21-43ee-904c-9d05b5e8d9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:25:03.272908 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83355f-1d21-43ee-904c-9d05b5e8d9fa admin admin] PATH_INFO: `/v3/users/bff138c7d7a440a0b6840dcaee526ef2` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:25:03.274277 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83355f-1d21-43ee-904c-9d05b5e8d9fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff138c7d7a440a0b6840dcaee526ef2)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:25:03.276328 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83355f-1d21-43ee-904c-9d05b5e8d9fa admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:25:03.348671 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-7f83355f-1d21-43ee-904c-9d05b5e8d9fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff138c7d7a440a0b6840dcaee526ef2'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:03.358753 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-7f83355f-1d21-43ee-904c-9d05b5e8d9fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff138c7d7a440a0b6840dcaee526ef2'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:03.384224 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-7f83355f-1d21-43ee-904c-9d05b5e8d9fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff138c7d7a440a0b6840dcaee526ef2'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:03.395912 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-7f83355f-1d21-43ee-904c-9d05b5e8d9fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff138c7d7a440a0b6840dcaee526ef2'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:03.397086 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-7f83355f-1d21-43ee-904c-9d05b5e8d9fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff138c7d7a440a0b6840dcaee526ef2'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:03.404540 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 635/1252] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Jul 28 11:25:03 2022] DELETE /identity/v3/users/bff138c7d7a440a0b6840dcaee526ef2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 11:25:03.632058 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b966d4-32b3-4c0a-b25e-842990f04388 admin admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:25:03.634448 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-61b966d4-32b3-4c0a-b25e-842990f04388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:25:03.656745 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b966d4-32b3-4c0a-b25e-842990f04388 admin admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:25:03.737693 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc41e98-0d6b-45d0-b5e1-4357deace2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:25:03.738982 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc41e98-0d6b-45d0-b5e1-4357deace2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:25:03.739613 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc41e98-0d6b-45d0-b5e1-4357deace2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:25:03.740139 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc41e98-0d6b-45d0-b5e1-4357deace2cc admin admin] PATH_INFO: `/v3/projects/1ee0293c8a674ddf9ea9193a45824d6d` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:25:03.742359 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc41e98-0d6b-45d0-b5e1-4357deace2cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ee0293c8a674ddf9ea9193a45824d6d)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:25:03.745964 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc41e98-0d6b-45d0-b5e1-4357deace2cc admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:25:03.763644 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:03.823393 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-7fc41e98-0d6b-45d0-b5e1-4357deace2cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ee0293c8a674ddf9ea9193a45824d6d', 'request_id': 'req-7fc41e98-0d6b-45d0-b5e1-4357deace2cc'} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:03.831455 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-7fc41e98-0d6b-45d0-b5e1-4357deace2cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ee0293c8a674ddf9ea9193a45824d6d', 'request_id': 'req-7fc41e98-0d6b-45d0-b5e1-4357deace2cc'} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:03.841789 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-7fc41e98-0d6b-45d0-b5e1-4357deace2cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ee0293c8a674ddf9ea9193a45824d6d', 'request_id': 'req-7fc41e98-0d6b-45d0-b5e1-4357deace2cc'} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:03.864821 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-7fc41e98-0d6b-45d0-b5e1-4357deace2cc admin admin] The token cache is being invalidate because project 1ee0293c8a674ddf9ea9193a45824d6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 11:25:03.865474 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-7fc41e98-0d6b-45d0-b5e1-4357deace2cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:03.866273 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-7fc41e98-0d6b-45d0-b5e1-4357deace2cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:25:03.867992 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 618/1253] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Jul 28 11:25:03 2022] DELETE /identity/v3/projects/1ee0293c8a674ddf9ea9193a45824d6d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:25:13.400739 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=46,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:25:13.858439 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:30.084372 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83355f-1d21-43ee-904c-9d05b5e8d9fa admin admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:26:30.086105 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-7f83355f-1d21-43ee-904c-9d05b5e8d9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:26:30.170173 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83355f-1d21-43ee-904c-9d05b5e8d9fa admin admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:26:30.228512 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fcb26-9cf8-4255-82d6-ab54464b1497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd087e64f5714585a53556a8dda546e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:26:30.229168 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fcb26-9cf8-4255-82d6-ab54464b1497 service neutron] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:26:30.229448 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fcb26-9cf8-4255-82d6-ab54464b1497 service neutron] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:26:30.229725 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fcb26-9cf8-4255-82d6-ab54464b1497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:26:30.231840 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-536fcb26-9cf8-4255-82d6-ab54464b1497 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:26:30.307585 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fcb26-9cf8-4255-82d6-ab54464b1497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:26:30.309074 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fcb26-9cf8-4255-82d6-ab54464b1497 service neutron] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:26:30.320607 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 636/1254] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:26:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 11:26:37.805867 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069ce38-4777-4181-a450-fd43707bd586 None None] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:26:37.806568 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069ce38-4777-4181-a450-fd43707bd586 None None] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:26:37.807024 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069ce38-4777-4181-a450-fd43707bd586 None None] PATH_INFO: `/` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:26:37.809595 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 619/1255] 10.222.0.71 () {54 vars in 921 bytes} [Thu Jul 28 11:26:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 11:26:37.844117 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5f40a-c60d-4896-8587-7a7c97f4e5a1 None None] REQUEST_METHOD: `POST` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:26:37.845337 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5f40a-c60d-4896-8587-7a7c97f4e5a1 None None] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:26:37.845834 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5f40a-c60d-4896-8587-7a7c97f4e5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:26:37.878424 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.auth.core [None req-dee5f40a-c60d-4896-8587-7a7c97f4e5a1 None None] MFA Rules not processed for user `8f4cb7d2680d4eb99a7328a54fcfd351`. Rule list: `[]` (Enabled: `True`). {{(pid=87205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 11:26:37.880940 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-dee5f40a-c60d-4896-8587-7a7c97f4e5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:26:37.889200 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069ce38-4777-4181-a450-fd43707bd586 None None] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:26:37.892651 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-e069ce38-4777-4181-a450-fd43707bd586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:26:37.920190 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069ce38-4777-4181-a450-fd43707bd586 None None] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:26:37.930519 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d5c47-fb96-41b9-9569-9cc8b43fe517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:26:37.931297 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d5c47-fb96-41b9-9569-9cc8b43fe517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:26:37.931680 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d5c47-fb96-41b9-9569-9cc8b43fe517 admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:26:37.932028 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d5c47-fb96-41b9-9569-9cc8b43fe517 admin admin] PATH_INFO: `/v3/users/648b88fec52849fb881c6a0c6444e357` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:26:37.954860 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d5c47-fb96-41b9-9569-9cc8b43fe517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=648b88fec52849fb881c6a0c6444e357)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:26:37.956662 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: WARNING py.warnings [None req-ae6d5c47-fb96-41b9-9569-9cc8b43fe517 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:37.956662 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: warnings.warn(msg) Jul 28 11:26:37.956662 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: Jul 28 11:26:37.958942 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d5c47-fb96-41b9-9569-9cc8b43fe517 admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:26:37.975549 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=100 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:37.994234 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 637/1256] 10.222.0.71 () {58 vars in 1018 bytes} [Thu Jul 28 11:26:37 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 11:26:38.010994 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5f40a-c60d-4896-8587-7a7c97f4e5a1 None None] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:26:38.012908 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-dee5f40a-c60d-4896-8587-7a7c97f4e5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:26:38.031024 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5f40a-c60d-4896-8587-7a7c97f4e5a1 None None] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:26:38.036759 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7b1ac-1de3-4c20-9011-96bf233eeafe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4cb7d2680d4eb99a7328a54fcfd351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:26:38.037417 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7b1ac-1de3-4c20-9011-96bf233eeafe service placement] REQUEST_METHOD: `GET` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:26:38.037708 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7b1ac-1de3-4c20-9011-96bf233eeafe service placement] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:26:38.037992 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7b1ac-1de3-4c20-9011-96bf233eeafe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:26:38.048169 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7b1ac-1de3-4c20-9011-96bf233eeafe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:26:38.049919 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7b1ac-1de3-4c20-9011-96bf233eeafe service placement] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:26:38.050823 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-ae6d5c47-fb96-41b9-9569-9cc8b43fe517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '648b88fec52849fb881c6a0c6444e357'} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:38.061481 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 638/1257] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:26:38 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 11:26:38.067631 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-ae6d5c47-fb96-41b9-9569-9cc8b43fe517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '648b88fec52849fb881c6a0c6444e357'} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:38.068834 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-ae6d5c47-fb96-41b9-9569-9cc8b43fe517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '648b88fec52849fb881c6a0c6444e357'} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:38.082376 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-ae6d5c47-fb96-41b9-9569-9cc8b43fe517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '648b88fec52849fb881c6a0c6444e357'} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:38.106167 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-ae6d5c47-fb96-41b9-9569-9cc8b43fe517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '648b88fec52849fb881c6a0c6444e357'} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:38.113425 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 620/1258] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Jul 28 11:26:37 2022] DELETE /identity/v3/users/648b88fec52849fb881c6a0c6444e357 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:26:38.351183 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7b1ac-1de3-4c20-9011-96bf233eeafe service placement] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:26:38.367144 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7b1ac-1de3-4c20-9011-96bf233eeafe service placement] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:26:38.447864 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada00540-5ba6-4b9b-9c6d-1bd1ec7cea0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:26:38.448543 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada00540-5ba6-4b9b-9c6d-1bd1ec7cea0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:26:38.448828 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada00540-5ba6-4b9b-9c6d-1bd1ec7cea0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:26:38.449106 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada00540-5ba6-4b9b-9c6d-1bd1ec7cea0a admin admin] PATH_INFO: `/v3/projects/756c72c8325f48f38b53ca96b5e06dba` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:26:38.462831 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada00540-5ba6-4b9b-9c6d-1bd1ec7cea0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=756c72c8325f48f38b53ca96b5e06dba)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:26:38.464042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: WARNING py.warnings [None req-ada00540-5ba6-4b9b-9c6d-1bd1ec7cea0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 11:26:38.464042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: warnings.warn(msg) Jul 28 11:26:38.464042 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: Jul 28 11:26:38.465282 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada00540-5ba6-4b9b-9c6d-1bd1ec7cea0a admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:26:38.536216 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-ada00540-5ba6-4b9b-9c6d-1bd1ec7cea0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '756c72c8325f48f38b53ca96b5e06dba', 'request_id': 'req-ada00540-5ba6-4b9b-9c6d-1bd1ec7cea0a'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:38.543218 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-ada00540-5ba6-4b9b-9c6d-1bd1ec7cea0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '756c72c8325f48f38b53ca96b5e06dba', 'request_id': 'req-ada00540-5ba6-4b9b-9c6d-1bd1ec7cea0a'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:38.552459 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-ada00540-5ba6-4b9b-9c6d-1bd1ec7cea0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '756c72c8325f48f38b53ca96b5e06dba', 'request_id': 'req-ada00540-5ba6-4b9b-9c6d-1bd1ec7cea0a'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:38.573947 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-ada00540-5ba6-4b9b-9c6d-1bd1ec7cea0a admin admin] The token cache is being invalidate because project 756c72c8325f48f38b53ca96b5e06dba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 11:26:38.574382 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-ada00540-5ba6-4b9b-9c6d-1bd1ec7cea0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:38.575425 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-ada00540-5ba6-4b9b-9c6d-1bd1ec7cea0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:38.577737 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 639/1259] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Jul 28 11:26:38 2022] DELETE /identity/v3/projects/756c72c8325f48f38b53ca96b5e06dba => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 11:26:38.582735 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d5c47-fb96-41b9-9569-9cc8b43fe517 admin admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:26:38.584467 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-ae6d5c47-fb96-41b9-9569-9cc8b43fe517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:26:38.599799 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d5c47-fb96-41b9-9569-9cc8b43fe517 admin admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:26:38.675528 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657725eb-b11e-4519-8a5f-879c73c8de0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:26:38.676603 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657725eb-b11e-4519-8a5f-879c73c8de0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:26:38.676919 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657725eb-b11e-4519-8a5f-879c73c8de0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:26:38.677094 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657725eb-b11e-4519-8a5f-879c73c8de0d admin admin] PATH_INFO: `/v3/users/60e0308150384b288194f07c3715fbc8` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:26:38.693139 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657725eb-b11e-4519-8a5f-879c73c8de0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=60e0308150384b288194f07c3715fbc8)` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:26:38.695169 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657725eb-b11e-4519-8a5f-879c73c8de0d admin admin] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:26:38.755824 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-657725eb-b11e-4519-8a5f-879c73c8de0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60e0308150384b288194f07c3715fbc8'} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:38.761707 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:38.765916 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-657725eb-b11e-4519-8a5f-879c73c8de0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60e0308150384b288194f07c3715fbc8'} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:38.767208 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-657725eb-b11e-4519-8a5f-879c73c8de0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60e0308150384b288194f07c3715fbc8'} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:38.776772 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-657725eb-b11e-4519-8a5f-879c73c8de0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60e0308150384b288194f07c3715fbc8'} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:38.791720 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.notifications [None req-657725eb-b11e-4519-8a5f-879c73c8de0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60e0308150384b288194f07c3715fbc8'} {{(pid=87206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:38.800309 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 621/1260] 10.222.0.71 () {58 vars in 1224 bytes} [Thu Jul 28 11:26:38 2022] DELETE /identity/v3/users/60e0308150384b288194f07c3715fbc8 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 11:26:39.065633 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada00540-5ba6-4b9b-9c6d-1bd1ec7cea0a admin admin] Authenticating user token {{(pid=87205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:26:39.067575 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.fernet_utils [None req-ada00540-5ba6-4b9b-9c6d-1bd1ec7cea0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:26:39.081516 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada00540-5ba6-4b9b-9c6d-1bd1ec7cea0a admin admin] Validating token access rules against request {{(pid=87205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:26:39.177984 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9adc2-a931-4e7d-826d-a41d18f7a894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5277cece91a843118766eb0b5a214210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584d842f145544c78397d7b263b77dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:26:39.178987 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9adc2-a931-4e7d-826d-a41d18f7a894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:26:39.179480 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9adc2-a931-4e7d-826d-a41d18f7a894 admin admin] SCRIPT_NAME: `/identity` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:26:39.179818 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9adc2-a931-4e7d-826d-a41d18f7a894 admin admin] PATH_INFO: `/v3/projects/0b62b6e536ae47cdb8ebe3ece408dcdf` {{(pid=87205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:26:39.182311 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:39.195977 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9adc2-a931-4e7d-826d-a41d18f7a894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b62b6e536ae47cdb8ebe3ece408dcdf)` {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:26:39.198353 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9adc2-a931-4e7d-826d-a41d18f7a894 admin admin] RBAC: Authorization granted {{(pid=87205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:26:39.256619 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-78d9adc2-a931-4e7d-826d-a41d18f7a894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b62b6e536ae47cdb8ebe3ece408dcdf', 'request_id': 'req-78d9adc2-a931-4e7d-826d-a41d18f7a894'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:39.263414 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-78d9adc2-a931-4e7d-826d-a41d18f7a894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b62b6e536ae47cdb8ebe3ece408dcdf', 'request_id': 'req-78d9adc2-a931-4e7d-826d-a41d18f7a894'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:39.273380 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-78d9adc2-a931-4e7d-826d-a41d18f7a894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b62b6e536ae47cdb8ebe3ece408dcdf', 'request_id': 'req-78d9adc2-a931-4e7d-826d-a41d18f7a894'} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:39.288066 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-78d9adc2-a931-4e7d-826d-a41d18f7a894 admin admin] The token cache is being invalidate because project 0b62b6e536ae47cdb8ebe3ece408dcdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 11:26:39.288421 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-78d9adc2-a931-4e7d-826d-a41d18f7a894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:39.289173 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG keystone.notifications [None req-78d9adc2-a931-4e7d-826d-a41d18f7a894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 11:26:39.290877 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: [pid: 87205|app: 0|req: 640/1261] 10.222.0.71 () {58 vars in 1233 bytes} [Thu Jul 28 11:26:39 2022] DELETE /identity/v3/projects/0b62b6e536ae47cdb8ebe3ece408dcdf => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 11:26:48.794677 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=10,keystone:INSERT=1,keystone:DELETE=3 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:26:49.284292 dv-osbrick-850937-3-ceph devstack@keystone.service[87205]: DEBUG dbcounter [-] [87205] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 11:29:15.575940 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657725eb-b11e-4519-8a5f-879c73c8de0d admin admin] Authenticating user token {{(pid=87206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 11:29:15.577591 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-657725eb-b11e-4519-8a5f-879c73c8de0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:29:15.669076 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657725eb-b11e-4519-8a5f-879c73c8de0d admin admin] Validating token access rules against request {{(pid=87206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 11:29:15.737919 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf33577-8d3c-4f65-a56f-e005fc7730bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4cb7d2680d4eb99a7328a54fcfd351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f4749185bf4adba9ae3cf927b6880b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 11:29:15.738566 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33577-8d3c-4f65-a56f-e005fc7730bd service placement] REQUEST_METHOD: `GET` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 11:29:15.738851 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33577-8d3c-4f65-a56f-e005fc7730bd service placement] SCRIPT_NAME: `/identity` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 11:29:15.739132 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33577-8d3c-4f65-a56f-e005fc7730bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 11:29:15.741116 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.fernet_utils [None req-bbf33577-8d3c-4f65-a56f-e005fc7730bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 11:29:15.753750 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf33577-8d3c-4f65-a56f-e005fc7730bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 11:29:15.755494 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf33577-8d3c-4f65-a56f-e005fc7730bd service placement] RBAC: Authorization granted {{(pid=87206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 11:29:15.766904 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: [pid: 87206|app: 0|req: 622/1262] 10.222.0.71 () {60 vars in 1365 bytes} [Thu Jul 28 11:29:15 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 11:29:25.762279 dv-osbrick-850937-3-ceph devstack@keystone.service[87206]: DEBUG dbcounter [-] [87206] Writing DB stats keystone:SELECT=62 {{(pid=87206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}